| Age | Commit message (Collapse) | Author | |
|---|---|---|---|
| 4 days | indexmajig: Free some stuff (in main process)HEADmaster | Thomas White | |
| This slightly reduces spam in Valgrind output. | |||
| 2024-07-15 | im-sandbox: fix bounds of snprintf statements | Philipp Middendorf | |
| I was noticing a segmentation fault appearing at the end of an indexamajig call. Debugging gave me: snprintf (__fmt=0x40d1fd "%s/mosflm.lp", __n=127, __s=0x471f90 "") delete_temporary_folder (n_proc=12, tmpdir=0x427c00 "./indexamajig.260408") at ../src/im-sandbox.c:1100 Which led me to these snprintf statements. Easily fixed, but a bit had to spot. | |||
| 2024-04-29 | indexamajig: Send ASAP::O acknowledgement only after process_image | Thomas White | |
| Otherwise, we end up acknowledging the previous message ID after receiving something like kEndOfStream. | |||
| 2024-04-29 | indexamajig: Report ASAP::O message ID for acknowledgement | Thomas White | |
| Something strange is going on here, need to debug. | |||
| 2024-04-24 | indexamajig: Add ASAP::O acknowledgements | Thomas White | |
| 2023-12-22 | indexamajig: Add --no-data-timeout | Thomas White | |
| 2023-09-23 | indexamajig: Re-use the image data arrays | Thomas White | |
| We noticed that constant freeing and re-allocating the (potentially quite large) arrays resulted in much lower performance. Since we know that all images have the same data layout, we can safely re-use the arrays. This gives a large speedup. | |||
| 2023-09-21 | indexamajig: Increase buffer size for Mille filename | Thomas White | |
| With the prefix, it can get quite long. | |||
| 2023-09-20 | indexamajig: Add --mille-dir | Thomas White | |
| 2023-08-24 | Use built-in Mille writer instead of wrapping C++ version | Thomas White | |
| 2023-07-28 | Move Mille stuff to separate file | Thomas White | |
| 2023-07-28 | indexamajig: Hooks for Mille | Thomas White | |
| 2023-07-27 | Fix some more memory leaks | Thomas White | |
| 2023-07-26 | indexamajig: Fix a few small memory leaks | Thomas White | |
| 2023-06-01 | indexamajig: Add --asapo-output-stream (hits only) | Thomas White | |
| 2023-06-01 | ASAP::O: Use message ID as serial number | Thomas White | |
| 2023-05-02 | Avoid unused variable if compiled without HAVE_SCHED_SETAFFINITY | Thomas White | |
| 2023-05-02 | indexamajig: Add --cpu-pin | Thomas White | |
| Similar code was stripped out 3.5 years ago by 4f4e5d05269eee6b192c271f2f9730a1ad3a4fbd. However, it seems there are still systems where it improves performance a lot. | |||
| 2022-11-08 | indexamajig: Exit only once all workers received kEndOfStream | Thomas White | |
| Previously, the whole program would exit if any worker saw kEndOfStream. Unfortunately, this happens quite often, due to data starvation (too many workers for the data rate) or just general slowness. Therefore we need a more robust criterion. | |||
| 2022-10-05 | indexamajig: Improve accuracy of speed reports | Thomas White | |
| 2022-07-07 | indexamajig: Remove separate waitpid() calls when cleaning up last processes | Thomas White | |
| 2022-07-06 | indexamajig: Add timeout for ZMQ socket | Thomas White | |
| 2022-07-06 | indexamajig: Add profiling and last_task info for ZMQ fetch | Thomas White | |
| 2022-06-22 | indexamajig: Wrap ZMQ parameters into separate structure | Thomas White | |
| 2022-06-22 | indexamajig: Wrap ASAP::O parameters up inside separate structure | Thomas White | |
| 2022-06-17 | ASAP::O: Simplify by removing stream switching logic | Thomas White | |
| 2022-06-16 | ASAP::O: Exit quicker (and with explanation) if setup fails | Thomas White | |
| 2022-06-02 | ASAP::O: Add last_task for ASAPO fetch | Thomas White | |
| 2022-06-02 | Add worker ID to profiling data | Thomas White | |
| 2022-06-02 | indexamajig: Add --asapo-stream | Thomas White | |
| 2022-06-02 | indexamajig: Track metadata (e.g. for ASAP::O) | Thomas White | |
| 2022-06-02 | ASAP::O: Add profiling bits | Thomas White | |
| 2022-06-02 | Generate placeholder filename/event earlier | Thomas White | |
| Previously, a placeholder was put in the queue ("ZMQdata //" or "ASAPOdata //"), and replaced by image_read_data_block. Instead, the "final" placeholder can be put in the queue already. Note that ASAP::O, at least, will replace this placeholder with a filename delivered by the data transport. | |||
| 2022-06-02 | ASAP::O: Pass filename through | Thomas White | |
| 2022-06-02 | ASAP::O: Remove filesystem path | Thomas White | |
| This is only really needed for offline processing. It's an added complication for now. Maybe we'll revisit it later and re-expose this, though. | |||
| 2022-06-02 | ASAP::O: Expose data source | Thomas White | |
| 2022-06-02 | ASAP::O: Simplify im_asapo_make_unique_group_id | Thomas White | |
| 2022-06-02 | ASAP::O: Don't send data to process_image if nothing came | Thomas White | |
| 2022-06-02 | ASAP::O: Show the uniquely-generated group ID | Thomas White | |
| 2022-06-02 | indexamajig: Don't do ASAP::O stuff unless asked for | Thomas White | |
| 2022-06-02 | indexamajig: Exit if unique ASAP::O group ID can't be created | Thomas White | |
| 2022-06-02 | indexamajig: Special cases for ASAP::O as for ZMQ | Thomas White | |
| 2022-06-02 | ASAP::O: Remove vestigial block | Thomas White | |
| 2022-06-02 | ASAP::O: Fix memory leak on error path | Thomas White | |
| 2022-06-02 | ASAP::O: Tidy up build process | Thomas White | |
| This removes a lot of random #ifdefs from the source code. | |||
| 2022-06-02 | Fix build without ASAP::O | Thomas White | |
| 2022-06-02 | ASAP::O: Actually get the data | Thomas White | |
| 2022-06-02 | ASAP::O: Group ID stuff | Thomas White | |
| 2022-06-02 | ASAP::O guts | Thomas White | |
| 2022-05-04 | Write profile information in one call to write() | Thomas White | |
| Unfortunately, the complicated series of nested printf()s doesn't work well from multiple processes. | |||
 |
index : CrystFEL | |
| Data processing for serial crystallography | Thomas White |
| aboutsummaryrefslogtreecommitdiff |