Simon Michael
356e2ba88a
fix:journal: repair 1.50's journal reading slowness [ #2493 ]
...
Since 1.50, sourceFilePath, which does IO operations, was being called for every item in the journal.
On my machine this was causing a ~40% slowdown,
but probably it could be more depending on storage system.
Now it's once again called only once per include directive.
Speed seems slightly better now than 1.43 for some reason
(eg: 13k txns/s -> 8k txns/s -> 14k txns/s).
2025-11-15 21:22:36 -10:00
Simon Michael
2f007c93d2
dev: switch all qualifed imports to ImportQualifiedPost style
2025-09-29 19:28:59 -10:00
Simon Michael
e51e6c4e3d
;dev: remove old prototype
2025-09-29 18:35:20 -10:00
Simon Michael
5db4ee7420
dev:Hledger.Utils.IO: readHandlePortably, readHandlePortably' -> hGetContentsPortably
2025-09-26 01:08:43 -10:00
Simon Michael
9351c70f74
fix:csv: respect encoding rule when rules file is input file [ #2465 ]
2025-09-26 00:34:01 -10:00
Simon Michael
6d164b48a0
imp:journal: in amounts, also allow and ignore empty {} (or {{}})
2025-09-11 07:33:22 +01:00
Simon Michael
7ac0fa1aaa
dev:TimeclockReader, Timeclock: refactor/reindent [ #2417 ]
2025-09-01 08:27:01 +01:00
Simon Michael
e37caf0f27
imp:journal: better error when attempting to include a rules file
2025-09-01 08:26:44 +01:00
Simon Michael
efe1d11edb
fix:timeclock: --old-timeclock also affects included files [ #2417 ]
...
This required changing the Reader type and passing InputOpts down to
journal's include directive parser.
2025-09-01 08:26:44 +01:00
Simon Michael
5a3e34cc55
imp:timeclock: syntax is more robust and featureful
...
The default timeclock parser (ie when not using --old-timeclock) has
the following changes, related to issues such as
[#2141 ], [#2365 ], [#2400 ], [#2417 ]:
- semicolon now always starts a comment; timeclock account names can't include semicolons
(though journal account names still can)
- clock-in and clock-out entries now have different syntax
- clock-ins now require an account name
- clock-outs now can have a comment and tags
- the doc has been rewritten, and now mentions the --old-timeclock flag
- lib: accountnamep and modifiedaccountnamep now take a flag to allow semicolons or not
2025-08-31 10:58:37 +01:00
Simon Michael
97899f9a9b
feat:csv: support data generating scripts
...
and rewrite the rules reader.
2025-08-28 21:38:38 +01:00
Simon Michael
b22f94007f
dev: source, archive, rules reader: improve docs
2025-08-28 21:38:38 +01:00
Simon Michael
e796a00fc4
dev:import: drop archiving of original data
...
just archive clean data
2025-08-28 21:38:38 +01:00
Simon Michael
b64ddfe813
dev:rules reader: drop "fall back to reading latest archived"
2025-08-28 21:38:38 +01:00
Simon Michael
c60ec90756
dev:import: improve buggy detection of import command
2025-08-28 21:38:38 +01:00
Simon Michael
c515fedf70
feat:csv: support data cleaning scripts
2025-08-28 21:38:38 +01:00
Simon Michael
cb1d6a71a6
dev:import:archive: fix bugs in new code
...
Too hard to rebase
2025-08-14 19:22:52 +01:00
Simon Michael
7dfe2d84e7
dev:import: fix debug message
2025-08-14 17:52:54 +01:00
Simon Michael
88b451d6eb
imp: when source rule finds no files, read the latest archived
2025-08-14 14:23:53 +01:00
Simon Michael
3dec0a8944
dev: indentation
2025-08-14 14:23:53 +01:00
Simon Michael
76dc6d089a
feat:import:archive: archive data files, and process oldest first
2025-08-14 12:54:40 +01:00
Simon Michael
db7783b16d
dev: cleanups
2025-08-14 12:54:40 +01:00
Simon Michael
bfbef4bcbb
dev: refactor PrefixedFilePath
2025-08-14 12:37:11 +01:00
Simon Michael
e69c72a6c7
dev: include: revert wrong error position fix; refactor
...
Errors in the main file are being reported a few lines too high,
due to the setOffset in includedirectivep.
It seems reverting this should have restored the original bug with
wrong line number in certain include error messages, but I can't find
that right now.
2025-07-28 11:57:46 +01:00
Simon Michael
c48c41bcd2
dev:timeclock: cleanups
2025-07-18 07:17:45 -07:00
Simon Michael
b7e35f84a2
imp: include: add hidden --old-glob flag to restore old dot behaviour
...
This disables the workaround for Glob#49, allowing glob patterns to
find dot files and traverse dot directories again (sometimes too much).
2025-07-17 08:00:08 -07:00
Simon Michael
5ec770badd
imp: include: more flexible **; show the correct line in read errors
2025-07-16 06:52:19 -07:00
Simon Michael
b35dcfda28
imp: include: give a clearer error for trying to include a csv file
...
And note that other read errors may be unclear when occurring in included files.
2025-07-16 06:52:19 -07:00
Simon Michael
8215f19baa
dev: include: cleanup
2025-07-16 06:52:19 -07:00
Simon Michael
3741f9f030
fix: include: report read failures with correct line number
2025-07-16 06:52:19 -07:00
Simon Michael
2dcfe22c89
imp: include: report ** without / as an error, for clarity
2025-07-16 06:52:19 -07:00
Simon Michael
460ae28826
imp: include: globs exclude current file; more cleanup
2025-07-16 06:52:19 -07:00
Simon Michael
b4a1add267
imp: include: more robust tests and glob pattern handling
...
This switches from filepattern back to Glob, which is more powerful.
New notes, implementation, workarounds and tests.
2025-07-16 06:52:19 -07:00
Simon Michael
1046f652b1
dev: PrefixedFilePath cleanups
...
And some helpers that weren't needed after all, but maybe in future
2025-07-16 06:52:19 -07:00
Simon Michael
28f60bcf92
dev: includedirectivep: refactor
2025-07-11 20:34:50 -07:00
Simon Michael
3a03927018
imp: include: show including file path in debug output
2025-07-11 20:12:13 -07:00
Simon Michael
0add2e90db
imp: include: glob patterns always exclude the current file
...
Eg include **/*.journal is less likely no complain
2025-07-11 19:36:17 -07:00
Simon Michael
08017366b5
imp: file reading: demote some debug=6 output to level 7
2025-07-11 13:48:58 -07:00
Simon Michael
536589e2c2
imp: include: improve cycle and read failure error messages
2025-07-11 13:36:47 -07:00
Simon Michael
b71e001c51
imp: include: more robust ** patterns, and ignore dotted directories
...
** now ignores anything under dotted directories, ie directories whose
name begins with a dot. Eg .git/, foo/.secret/, etc.
Switched from Glob to filepattern lib.
2025-07-11 13:36:47 -07:00
Simon Michael
b1f416dee7
dev: parseIncludedFile: doc cleanup
2025-07-11 13:01:54 -07:00
Simon Michael
b7c4dc3b53
fix:journal: cyclic include error messages now show the correct line
2025-07-11 13:00:51 -07:00
Simon Michael
801a7adaa4
imp:include: better errors, eg for missing argument; more debug output
2025-07-11 12:13:52 -07:00
Simon Michael
c8a5b8eb37
dev: includedirectivep: cleanup
2025-07-11 12:13:12 -07:00
Simon Michael
f5d3b7bd38
fix:journal: include directive error messages now show the correct line
...
They were showing the line after the include directive, confusingly.
2025-07-11 11:55:29 -07:00
Simon Michael
2815a1865f
dev: includedirectivep: cleanups, docs
2025-07-11 11:38:50 -07:00
Simon Michael
4a5775da71
imp: commodities/payees/tags: used/declared flags, like accounts
...
And general cleanup of options and help across
the accounts, commodities, payees, tags commands.
2025-06-15 07:32:40 -10:00
Simon Michael
de4d637def
dev: transaction balancing: cleanup [ #2402 ]
2025-06-12 17:55:13 -10:00
Simon Michael
bf90b20f2c
imp: --txn-balancing flag to select transaction balancing precision [ #2402 ]
2025-06-12 17:55:13 -10:00
Simon Michael
442bd24bc5
;dev: commodityStyleFromRawOpts: cleanup
2025-06-12 17:55:13 -10:00
