Instructions

  1. Extract code_and_docs.zip and packetdata.zipinto the same root directory.

*Depending on the extraction tool, extracting code_and_docs.zip may create an additional top-level directory (for example, code_and_docs/). If this happens, move or copy the contents of that directory into the parent/root directory so that the final directory structure matches the layout shown below.

  1. After extracting and arranging the files, read the README.md file included in code_and_docs.zip.

Packed files in the repository

FileDescription
code_and_docs.zipSource code, scripts, and documentation required to run and analyze the project.
packetdata.zipInput network packet data used in the experiments.
reproducible-env.sifApptainer image containing the software environment required to reproduce the experiments.
reproducible-env.tar.gzDocker image containing the software environment required to reproduce the experiments.
results_SlurmCluster_16workers_Aug2026.zipExperimental results obtained on a Slurm cluster using 16 workers in August 2026.
FIRST_OF_ALL.txtFile containing initial instructions and important information for reproducing the experiments.
results_local_8cores_160GbRAM_Aug2026.zipExperimental results obtained in a local environment with 8 CPU cores and 160 GB of RAM in August 2026.

Tested folder-structure (after extracting)

. в”њв”Ђв”Ђ build_docker.sh в”њв”Ђв”Ђ code в”‚В В  в”њв”Ђв”Ђ comparison_tests.py в”‚В В  в”њв”Ђв”Ђ datagen.py в”‚В В  в”њв”Ђв”Ђ fast_metrics.py в”‚В В  в”њв”Ђв”Ђ infrastructure_config в”‚В В  в”‚В В  в””в”Ђв”Ђ local.json в”‚В В  в”њв”Ђв”Ђ requirements.txt в”‚В В  в”њв”Ђв”Ђ run_all.sh в”‚В В  в”њв”Ђв”Ђ scaling.py в”‚В В  в”њв”Ђв”Ђ sdobase.py в”‚В В  в”њв”Ђв”Ђ sdoclust в”‚В В  в”‚В В  в””в”Ђв”Ђ clust.py в”‚В В  в”њв”Ђв”Ђ stream_config в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_iforest-frozen.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_iforest.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_kmeans_ddask-frozen.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_kmeans_ddask.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_kmeans_ndask-frozen.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_kmeans_ndask.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_sdo_dask.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_sdo-frozen_dask.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_sdo-frozen_numpy.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_ad_sdo_numpy.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_clust_fast-hdbscan.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_clust_kmeans_dask.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_clust_mbkmeans.json в”‚В В  в”‚В В  в”њв”Ђв”Ђ stream_clust_sdoclust_dask.json в”‚В В  в”‚В В  в””в”Ђв”Ђ stream_clust_sdoclust_numpy.json в”‚В В  в””в”Ђв”Ђ stream_test.py в”њв”Ђв”Ђ docker в”‚В В  в”њв”Ђв”Ђ docker-compose.yml в”‚В В  в”њв”Ђв”Ђ Dockerfile в”‚В В  в””в”Ђв”Ђ Makefile в”њв”Ђв”Ђ docs в”‚В В  в”њв”Ђв”Ђ comparison_tests.md в”‚В В  в”њв”Ђв”Ђ scaling.md в”‚В В  в”њв”Ђв”Ђ sdo.md в”‚В В  в””в”Ђв”Ђ stream_test.md в”њв”Ђв”Ђ packetdata в”‚В В  в”њв”Ђв”Ђ ... в”њв”Ђв”Ђ README.md в”њв”Ђв”Ђ reproducible-env.sif в”њв”Ђв”Ђ reproducible-env.tar.gz в”њв”Ђв”Ђ results в”њв”Ђв”Ђ results_local_8cores_160GbRAM_Aug2026.zip в”њв”Ђв”Ђ results_SlurmCluster_16workers_Aug2026.zip в”њв”Ђв”Ђ run_in_slurm В В  в”њв”Ђв”Ђ slurm.json В В  в””в”Ђв”Ђ submit_manager_distrib.sh