Age | Commit message (Collapse) | Author | |
---|---|---|---|
2022-06-02 | ASAP::O: Add profiling | Thomas White | |
2022-06-02 | Seedee deserialization | Thomas White | |
2022-06-02 | indexamajig: Track metadata (e.g. for ASAP::O) | Thomas White | |
2022-06-02 | ASAP::O: Add profiling bits | Thomas White | |
2022-06-02 | ASAP::O: Give up if there are no streams at all | Thomas White | |
2022-06-02 | Add instance ID and pipeline step | Thomas White | |
2022-06-02 | Generate placeholder filename/event earlier | Thomas White | |
Previously, a placeholder was put in the queue ("ZMQdata //" or "ASAPOdata //"), and replaced by image_read_data_block. Instead, the "final" placeholder can be put in the queue already. Note that ASAP::O, at least, will replace this placeholder with a filename delivered by the data transport. | |||
2022-06-02 | ASAP::O: Increase timeout to 3 seconds | Thomas White | |
2022-06-02 | ASAP::O: Set path to "auto" | Thomas White | |
2022-06-02 | ASAP::O: Comment out repetitive status message | Thomas White | |
2022-06-02 | ASAP::O: Fix call to get filename | Thomas White | |
2022-06-02 | ASAP::O: Pass filename through | Thomas White | |
2022-06-02 | ASAP::O: Fix comments | Thomas White | |
2022-06-02 | ASAP::O: Fix stream switching | Thomas White | |
2022-06-02 | ASAP::O: Fix memory leaks | Thomas White | |
2022-06-02 | ASAP::O: Fixes after testing for stream switching | Thomas White | |
2022-06-02 | ASAP::O: Stream switching | Thomas White | |
2022-06-02 | ASAP::O: Pass through data block size | Thomas White | |
2022-06-02 | ASAP::O: Remove filesystem path | Thomas White | |
This is only really needed for offline processing. It's an added complication for now. Maybe we'll revisit it later and re-expose this, though. | |||
2022-06-02 | ASAP::O: Expose data source | Thomas White | |
2022-06-02 | ASAP::O: Simplify im_asapo_make_unique_group_id | Thomas White | |
2022-06-02 | ASAP::O: Don't send data to process_image if nothing came | Thomas White | |
2022-06-02 | Formatting fussiness | Thomas White | |
2022-06-02 | ASAP::O: Show the uniquely-generated group ID | Thomas White | |
2022-06-02 | ASAP::O: Copy the data block | Thomas White | |
We may eventually want to avoid copying the entire data block, but it's an easy solution for now, and matches what we do for ZMQ. | |||
2022-06-02 | indexamajig: Don't do ASAP::O stuff unless asked for | Thomas White | |
2022-06-02 | indexamajig: Exit if unique ASAP::O group ID can't be created | Thomas White | |
2022-06-02 | ASAP::O: Use asapo_is_error() | Thomas White | |
2022-06-02 | indexamajig: Special cases for ASAP::O as for ZMQ | Thomas White | |
2022-06-02 | ASAP::O: Remove vestigial block | Thomas White | |
2022-06-02 | ASAP::O: Fix memory leak on error path | Thomas White | |
2022-06-02 | ASAP::O: Tidy up build process | Thomas White | |
This removes a lot of random #ifdefs from the source code. | |||
2022-06-02 | Fix build without ASAP::O | Thomas White | |
2022-06-02 | ASAP::O: Use asapo_string_from_c_str, which exists now | Thomas White | |
2022-06-02 | ASAP::O: Actually get the data | Thomas White | |
2022-06-02 | ASAP::O: Group ID stuff | Thomas White | |
2022-06-02 | ASAP::O guts | Thomas White | |
2022-06-02 | Merge branch 'better-profiling' | Thomas White | |
2022-06-02 | indexamajig: Put MsgPack peaks through validation procedure, like HDF5 | Thomas White | |
2022-06-02 | Update copyright dates | Thomas White | |
2022-05-31 | indexamajig: Fix JSON when not indexing/integrating | Thomas White | |
Fixes: https://gitlab.desy.de/thomas.white/crystfel/-/issues/68 | |||
2022-05-04 | Write profile information in one call to write() | Thomas White | |
Unfortunately, the complicated series of nested printf()s doesn't work well from multiple processes. | |||
2022-05-04 | Add improved profiling | Thomas White | |
Improvements: - Recursive, so we can see how things are working at different levels - Everything is profiled, even if not explicitly labelled - No possibility of losing time - Detects mistakes if routines aren't wrapped correctly | |||
2022-05-03 | Strip out time-accounts | Thomas White | |
2022-05-03 | partialator: Use default event ID in csplit for crystals which don't have one | Thomas White | |
2022-05-03 | partialator: Fix a typo | Thomas White | |
2022-04-05 | indexamajig: Fix profiling when using streamed data | Thomas White | |
2022-04-05 | GUI: Add desktop file and set application name | Thomas White | |
This fixes the broken window icon on Wayland. | |||
2022-04-01 | GUI: Improve an error message | Thomas White | |
2022-03-18 | GUI: Use sbatch/scancel/scontrol instead of Slurm API | Thomas White | |
This commit strips out all references to the Slurm API, instead making subprocess calls to sbatch and scontrol. Attempting to use the Slurm API seems to have been a mis-step. First, it seems that nowhere has the Slurm headers pre-installed. Literally none of the facilities where there are known deployments of CrystFEL have them. And in a significant fraction of cases, getting them installed is difficult, slow or impossible. In addition, the API doesn't seem to work in all cases, so we already shell out to 'scancel' to abort jobs - see d76fc3495. There are some tricky implications for submitting Slurm jobs from a container via the API. The Slurm REST API offers a solution, but is very new and not widely available. Calls to the Slurm executables are much easier to 'tunnel' out of a container. This isn't a great solution. It's a net increase of only about 40 lines of source code, but it incurs some unpleasant string handling and will probably be less reliable overall. It completely relies on Slurm's not being internationalised. If Slurm's messages start getting translated, we will be in trouble. |