mirror of
https://github.com/Freika/dawarich.git
synced 2026-01-12 02:01:39 -05:00
* fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements * Pull only necessary data for map v2 points * Feature/raw data archive (#2009) * 0.36.2 (#2007) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Remove esbuild scripts from package.json * Remove sideEffects field from package.json * Raw data archivation * Add tests * Fix tests * Fix tests * Update ExceptionReporter * Add schedule to run raw data archival job monthly * Change file structure for raw data archival feature * Update changelog and version for raw data archival feature --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Set raw_data to an empty hash instead of nil when archiving * Fix storage configuration and file extraction * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018) * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation * Remove raw data from visited cities api endpoint * Use user timezone to show dates on maps (#2020) * Fix/pre epoch time (#2019) * Use user timezone to show dates on maps * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Fix tests failing due to new index on stats table * Fix failing specs * Update redis client configuration to support unix socket connection * Update changelog * Fix kml kmz import issues (#2023) * Fix kml kmz import issues * Refactor KML importer to improve readability and maintainability * Implement moving points in map v2 and fix route rendering logic to ma… (#2027) * Implement moving points in map v2 and fix route rendering logic to match map v1. * Fix route spec * fix(maplibre): update date format to ISO 8601 (#2029) * Add verification step to raw data archival process (#2028) * Add verification step to raw data archival process * Add actual verification of raw data archives after creation, and only clear raw_data for verified archives. * Fix failing specs * Eliminate zip-bomb risk * Fix potential memory leak in js * Return .keep files * Use Toast instead of alert for notifications * Add help section to navbar dropdown * Update changelog * Remove raw_data_archival_job * Ensure file is being closed properly after reading in Archivable concern * Add composite index to stats table if not exists * Update changelog * Update entrypoint to always sync static assets (not only new ones) * Add family layer to MapLibre maps (#2055) * Add family layer to MapLibre maps * Update migration * Don't show family toggle if feature is disabled * Update changelog * Return changelog * Update changelog * Update tailwind file * Bump sentry-rails from 6.0.0 to 6.1.0 (#1945) Bumps [sentry-rails](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.1.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.1.0) --- updated-dependencies: - dependency-name: sentry-rails dependency-version: 6.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump turbo-rails from 2.0.17 to 2.0.20 (#1944) Bumps [turbo-rails](https://github.com/hotwired/turbo-rails) from 2.0.17 to 2.0.20. - [Release notes](https://github.com/hotwired/turbo-rails/releases) - [Commits](https://github.com/hotwired/turbo-rails/compare/v2.0.17...v2.0.20) --- updated-dependencies: - dependency-name: turbo-rails dependency-version: 2.0.20 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump webmock from 3.25.1 to 3.26.1 (#1943) Bumps [webmock](https://github.com/bblimke/webmock) from 3.25.1 to 3.26.1. - [Release notes](https://github.com/bblimke/webmock/releases) - [Changelog](https://github.com/bblimke/webmock/blob/master/CHANGELOG.md) - [Commits](https://github.com/bblimke/webmock/compare/v3.25.1...v3.26.1) --- updated-dependencies: - dependency-name: webmock dependency-version: 3.26.1 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump brakeman from 7.1.0 to 7.1.1 (#1942) Bumps [brakeman](https://github.com/presidentbeef/brakeman) from 7.1.0 to 7.1.1. - [Release notes](https://github.com/presidentbeef/brakeman/releases) - [Changelog](https://github.com/presidentbeef/brakeman/blob/main/CHANGES.md) - [Commits](https://github.com/presidentbeef/brakeman/compare/v7.1.0...v7.1.1) --- updated-dependencies: - dependency-name: brakeman dependency-version: 7.1.1 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump redis from 5.4.0 to 5.4.1 (#1941) Bumps [redis](https://github.com/redis/redis-rb) from 5.4.0 to 5.4.1. - [Changelog](https://github.com/redis/redis-rb/blob/master/CHANGELOG.md) - [Commits](https://github.com/redis/redis-rb/compare/v5.4.0...v5.4.1) --- updated-dependencies: - dependency-name: redis dependency-version: 5.4.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Put import deletion into background job (#2045) * Put import deletion into background job * Update changelog * fix null type error and update heatmap styling (#2037) * fix: use constant weight for maplibre heatmap layer * fix null type, update heatmap styling * improve heatmap styling * fix typo * Fix stats calculation to recursively reduce H3 resolution when too ma… (#2065) * Fix stats calculation to recursively reduce H3 resolution when too many hexagons are generated * Update CHANGELOG.md * Validate trip start and end dates (#2066) * Validate trip start and end dates * Update changelog * Update migration to clean up duplicate stats before adding unique index * Fix fog of war radius setting being ignored and applying settings causing errors (#2068) * Update changelog * Add Rack::Deflater middleware to config/application.rb to enable gzip compression for responses. * Add composite index to points on user_id and timestamp * Deduplicte points based on timestamp brought to unix time * Fix/stats cache invalidation (#2072) * Fix family layer toggle in Map v2 settings for non-selfhosted env * Invalidate cache * Remove comments * Remove comment * Add new indicies to improve performance and remove unused ones to opt… (#2078) * Add new indicies to improve performance and remove unused ones to optimize database. * Remove comments * Update map search suggestions panel styling * Add yearly digest (#2073) * Add yearly digest * Rename YearlyDigests to Users::Digests * Minor changes * Update yearly digest layout and styles * Add flags and chart to email * Update colors * Fix layout of stats in yearly digest view * Remove cron job for yearly digest scheduling * Update CHANGELOG.md * Update digest email setting handling * Allow sharing digest for 1 week or 1 month * Change Digests Distance to Bigint * Fix settings page * Update changelog * Add RailsPulse (#2079) * Add RailsPulse * Add RailsPulse monitoring tool with basic HTTP authentication * Bring points_count to integer * Update migration and version * Update rubocop issues * Fix migrations and data verification to remove safety_assured blocks and handle missing points gracefully. * Update version * Update calculation of time spent in a country for year-end digest email (#2110) * Update calculation of time spent in a country for year-end digest email * Add a filter to exclude raw data points when calculating yearly digests. * Bump trix from 2.1.15 to 2.1.16 in the npm_and_yarn group across 1 directory (#2098) * 0.37.1 (#2092) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements * Pull only necessary data for map v2 points * Feature/raw data archive (#2009) * 0.36.2 (#2007) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Remove esbuild scripts from package.json * Remove sideEffects field from package.json * Raw data archivation * Add tests * Fix tests * Fix tests * Update ExceptionReporter * Add schedule to run raw data archival job monthly * Change file structure for raw data archival feature * Update changelog and version for raw data archival feature --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Set raw_data to an empty hash instead of nil when archiving * Fix storage configuration and file extraction * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018) * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation * Remove raw data from visited cities api endpoint * Use user timezone to show dates on maps (#2020) * Fix/pre epoch time (#2019) * Use user timezone to show dates on maps * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Fix tests failing due to new index on stats table * Fix failing specs * Update redis client configuration to support unix socket connection * Update changelog * Fix kml kmz import issues (#2023) * Fix kml kmz import issues * Refactor KML importer to improve readability and maintainability * Implement moving points in map v2 and fix route rendering logic to ma… (#2027) * Implement moving points in map v2 and fix route rendering logic to match map v1. * Fix route spec * fix(maplibre): update date format to ISO 8601 (#2029) * Add verification step to raw data archival process (#2028) * Add verification step to raw data archival process * Add actual verification of raw data archives after creation, and only clear raw_data for verified archives. * Fix failing specs * Eliminate zip-bomb risk * Fix potential memory leak in js * Return .keep files * Use Toast instead of alert for notifications * Add help section to navbar dropdown * Update changelog * Remove raw_data_archival_job * Ensure file is being closed properly after reading in Archivable concern * Add composite index to stats table if not exists * Update changelog * Update entrypoint to always sync static assets (not only new ones) * Add family layer to MapLibre maps (#2055) * Add family layer to MapLibre maps * Update migration * Don't show family toggle if feature is disabled * Update changelog * Return changelog * Update changelog * Update tailwind file * Bump sentry-rails from 6.0.0 to 6.1.0 (#1945) Bumps [sentry-rails](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.1.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.1.0) --- updated-dependencies: - dependency-name: sentry-rails dependency-version: 6.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump turbo-rails from 2.0.17 to 2.0.20 (#1944) Bumps [turbo-rails](https://github.com/hotwired/turbo-rails) from 2.0.17 to 2.0.20. - [Release notes](https://github.com/hotwired/turbo-rails/releases) - [Commits](https://github.com/hotwired/turbo-rails/compare/v2.0.17...v2.0.20) --- updated-dependencies: - dependency-name: turbo-rails dependency-version: 2.0.20 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump webmock from 3.25.1 to 3.26.1 (#1943) Bumps [webmock](https://github.com/bblimke/webmock) from 3.25.1 to 3.26.1. - [Release notes](https://github.com/bblimke/webmock/releases) - [Changelog](https://github.com/bblimke/webmock/blob/master/CHANGELOG.md) - [Commits](https://github.com/bblimke/webmock/compare/v3.25.1...v3.26.1) --- updated-dependencies: - dependency-name: webmock dependency-version: 3.26.1 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump brakeman from 7.1.0 to 7.1.1 (#1942) Bumps [brakeman](https://github.com/presidentbeef/brakeman) from 7.1.0 to 7.1.1. - [Release notes](https://github.com/presidentbeef/brakeman/releases) - [Changelog](https://github.com/presidentbeef/brakeman/blob/main/CHANGES.md) - [Commits](https://github.com/presidentbeef/brakeman/compare/v7.1.0...v7.1.1) --- updated-dependencies: - dependency-name: brakeman dependency-version: 7.1.1 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump redis from 5.4.0 to 5.4.1 (#1941) Bumps [redis](https://github.com/redis/redis-rb) from 5.4.0 to 5.4.1. - [Changelog](https://github.com/redis/redis-rb/blob/master/CHANGELOG.md) - [Commits](https://github.com/redis/redis-rb/compare/v5.4.0...v5.4.1) --- updated-dependencies: - dependency-name: redis dependency-version: 5.4.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Put import deletion into background job (#2045) * Put import deletion into background job * Update changelog * fix null type error and update heatmap styling (#2037) * fix: use constant weight for maplibre heatmap layer * fix null type, update heatmap styling * improve heatmap styling * fix typo * Fix stats calculation to recursively reduce H3 resolution when too ma… (#2065) * Fix stats calculation to recursively reduce H3 resolution when too many hexagons are generated * Update CHANGELOG.md * Validate trip start and end dates (#2066) * Validate trip start and end dates * Update changelog * Update migration to clean up duplicate stats before adding unique index * Fix fog of war radius setting being ignored and applying settings causing errors (#2068) * Update changelog * Add Rack::Deflater middleware to config/application.rb to enable gzip compression for responses. * Add composite index to points on user_id and timestamp * Deduplicte points based on timestamp brought to unix time * Fix/stats cache invalidation (#2072) * Fix family layer toggle in Map v2 settings for non-selfhosted env * Invalidate cache * Remove comments * Remove comment * Add new indicies to improve performance and remove unused ones to opt… (#2078) * Add new indicies to improve performance and remove unused ones to optimize database. * Remove comments * Update map search suggestions panel styling * Add yearly digest (#2073) * Add yearly digest * Rename YearlyDigests to Users::Digests * Minor changes * Update yearly digest layout and styles * Add flags and chart to email * Update colors * Fix layout of stats in yearly digest view * Remove cron job for yearly digest scheduling * Update CHANGELOG.md * Update digest email setting handling * Allow sharing digest for 1 week or 1 month * Change Digests Distance to Bigint * Fix settings page * Update changelog * Add RailsPulse (#2079) * Add RailsPulse * Add RailsPulse monitoring tool with basic HTTP authentication * Bring points_count to integer * Update migration and version * Update rubocop issues * Fix migrations and data verification to remove safety_assured blocks and handle missing points gracefully. * Update version --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump trix in the npm_and_yarn group across 1 directory Bumps the npm_and_yarn group with 1 update in the / directory: [trix](https://github.com/basecamp/trix). Updates `trix` from 2.1.15 to 2.1.16 - [Release notes](https://github.com/basecamp/trix/releases) - [Commits](https://github.com/basecamp/trix/compare/v2.1.15...v2.1.16) --- updated-dependencies: - dependency-name: trix dependency-version: 2.1.16 dependency-type: direct:production dependency-group: npm_and_yarn ... Signed-off-by: dependabot[bot] <support@github.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Map v2 will no longer block the UI when Immich/Photoprism integration has a bad URL or is unreachable (#2113) * Bump rubocop-rails from 2.33.4 to 2.34.2 (#2080) Bumps [rubocop-rails](https://github.com/rubocop/rubocop-rails) from 2.33.4 to 2.34.2. - [Release notes](https://github.com/rubocop/rubocop-rails/releases) - [Changelog](https://github.com/rubocop/rubocop-rails/blob/master/CHANGELOG.md) - [Commits](https://github.com/rubocop/rubocop-rails/compare/v2.33.4...v2.34.2) --- updated-dependencies: - dependency-name: rubocop-rails dependency-version: 2.34.2 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump chartkick from 5.2.0 to 5.2.1 (#2081) Bumps [chartkick](https://github.com/ankane/chartkick) from 5.2.0 to 5.2.1. - [Changelog](https://github.com/ankane/chartkick/blob/master/CHANGELOG.md) - [Commits](https://github.com/ankane/chartkick/compare/v5.2.0...v5.2.1) --- updated-dependencies: - dependency-name: chartkick dependency-version: 5.2.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump rubyzip from 3.2.0 to 3.2.2 (#2082) Bumps [rubyzip](https://github.com/rubyzip/rubyzip) from 3.2.0 to 3.2.2. - [Release notes](https://github.com/rubyzip/rubyzip/releases) - [Changelog](https://github.com/rubyzip/rubyzip/blob/main/Changelog.md) - [Commits](https://github.com/rubyzip/rubyzip/compare/v3.2.0...v3.2.2) --- updated-dependencies: - dependency-name: rubyzip dependency-version: 3.2.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump sentry-ruby from 6.0.0 to 6.2.0 (#2083) Bumps [sentry-ruby](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.2.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.2.0) --- updated-dependencies: - dependency-name: sentry-ruby dependency-version: 6.2.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump sidekiq from 8.0.8 to 8.1.0 (#2084) Bumps [sidekiq](https://github.com/sidekiq/sidekiq) from 8.0.8 to 8.1.0. - [Changelog](https://github.com/sidekiq/sidekiq/blob/main/Changes.md) - [Commits](https://github.com/sidekiq/sidekiq/compare/v8.0.8...v8.1.0) --- updated-dependencies: - dependency-name: sidekiq dependency-version: 8.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Update digest calculation to use actual time spent in countries based… (#2115) * Update digest calculation to use actual time spent in countries based on consecutive points, avoiding double-counting days when crossing borders. * Move methods to private * Update Gemfile and Gemfile.lock to pin connection_pool and sidekiq versions * Rework country tracked days calculation * Adjust calculate_duration_in_minutes to only count continuous presence within cities, excluding long gaps. * Move helpers for digest city progress to a helper method * Implement globe projection option for Map v2 using MapLibre GL JS. * Update time spent calculation for country minutes in user digests * Stats are now calculated with more accuracy by storing total minutes spent per country. * Add globe_projection setting to safe settings * Remove console.logs from most of map v2 * Implement some performance improvements and caching for various featu… (#2133) * Implement some performance improvements and caching for various features. * Fix failing tests * Implement routes behaviour in map v2 to match map v1 * Fix route highlighting * Add fallbacks when retrieving full route features to handle cases where source data access methods vary. * Fix some e2e tests * Add immediate verification and count validation to raw data archiving (#2138) * Add immediate verification and count validation to raw data archiving * Remove verifying job * Add archive metrics reporting * Disable RailsPulse in Self-hosted Environments * Remove user_id and points_count parameters from Metrics::Archives::Operation and related calls. * Move points creation logic from background jobs to service objects (#2145) * Move points creation logic from background jobs to service objects * Remove unused point creation jobs * Update changelog * Add tracks to map v2 (#2142) * Add tracks to map v2 * Remove console log * Update tracks generation behavior to ignore distance threshold for frontend parity * Extract logic to services from TracksController#index and add tests * Move query logic for track listing into a service object. * Minor changes * Fix minor issues --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
373 lines
12 KiB
Ruby
373 lines
12 KiB
Ruby
# frozen_string_literal: true
|
|
|
|
require 'rails_helper'
|
|
|
|
RSpec.describe Tracks::ParallelGenerator do
|
|
let(:user) { create(:user) }
|
|
let(:generator) { described_class.new(user, **options) }
|
|
let(:options) { {} }
|
|
|
|
before do
|
|
Rails.cache.clear
|
|
# Stub user settings
|
|
allow(user.safe_settings).to receive(:minutes_between_routes).and_return(30)
|
|
allow(user.safe_settings).to receive(:meters_between_routes).and_return(500)
|
|
end
|
|
|
|
describe '#initialize' do
|
|
it 'sets default values' do
|
|
expect(generator.user).to eq(user)
|
|
expect(generator.start_at).to be_nil
|
|
expect(generator.end_at).to be_nil
|
|
expect(generator.mode).to eq(:bulk)
|
|
expect(generator.chunk_size).to eq(1.day)
|
|
end
|
|
|
|
it 'accepts custom options' do
|
|
start_time = 1.week.ago
|
|
end_time = Time.current
|
|
|
|
custom_generator = described_class.new(
|
|
user,
|
|
start_at: start_time,
|
|
end_at: end_time,
|
|
mode: :daily,
|
|
chunk_size: 2.days
|
|
)
|
|
|
|
expect(custom_generator.start_at).to eq(start_time)
|
|
expect(custom_generator.end_at).to eq(end_time)
|
|
expect(custom_generator.mode).to eq(:daily)
|
|
expect(custom_generator.chunk_size).to eq(2.days)
|
|
end
|
|
|
|
it 'converts mode to symbol' do
|
|
generator = described_class.new(user, mode: 'incremental')
|
|
expect(generator.mode).to eq(:incremental)
|
|
end
|
|
end
|
|
|
|
describe '#call' do
|
|
let!(:point1) { create(:point, user: user, timestamp: 2.days.ago.to_i) }
|
|
let!(:point2) { create(:point, user: user, timestamp: 1.day.ago.to_i) }
|
|
|
|
context 'with successful execution' do
|
|
it 'returns a session manager' do
|
|
result = generator.call
|
|
|
|
expect(result).to be_a(Tracks::SessionManager)
|
|
expect(result.user_id).to eq(user.id)
|
|
expect(result.session_exists?).to be true
|
|
end
|
|
|
|
it 'creates session with correct metadata' do
|
|
result = generator.call
|
|
|
|
session_data = result.get_session_data
|
|
expect(session_data['metadata']['mode']).to eq('bulk')
|
|
expect(session_data['metadata']['chunk_size']).to eq('1 day')
|
|
expect(session_data['metadata']['user_settings']['time_threshold_minutes']).to eq(30)
|
|
expect(session_data['metadata']['user_settings']['distance_threshold_meters']).to eq(500)
|
|
expect(session_data['metadata']['user_settings']['distance_threshold_behavior']).to eq('ignored_for_frontend_parity')
|
|
end
|
|
|
|
it 'marks session as started with chunk count' do
|
|
result = generator.call
|
|
|
|
session_data = result.get_session_data
|
|
expect(session_data['status']).to eq('processing')
|
|
expect(session_data['total_chunks']).to be > 0
|
|
expect(session_data['started_at']).to be_present
|
|
end
|
|
|
|
it 'enqueues time chunk processor jobs' do
|
|
expect do
|
|
generator.call
|
|
end.to have_enqueued_job(Tracks::TimeChunkProcessorJob).at_least(:once)
|
|
end
|
|
|
|
it 'enqueues boundary resolver job with delay' do
|
|
expect do
|
|
generator.call
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob).at(be >= 5.minutes.from_now)
|
|
end
|
|
|
|
it 'logs the operation' do
|
|
allow(Rails.logger).to receive(:info) # Allow any log messages
|
|
expect(Rails.logger).to receive(:info).with(/Started parallel track generation/).at_least(:once)
|
|
generator.call
|
|
end
|
|
end
|
|
|
|
context 'when no time chunks are generated' do
|
|
let(:user_no_points) { create(:user) }
|
|
let(:generator) { described_class.new(user_no_points) }
|
|
|
|
it 'returns 0 (no session created)' do
|
|
result = generator.call
|
|
expect(result).to eq(0)
|
|
end
|
|
|
|
it 'does not enqueue any jobs' do
|
|
expect do
|
|
generator.call
|
|
end.not_to have_enqueued_job
|
|
end
|
|
end
|
|
|
|
context 'with different modes' do
|
|
let!(:track1) { create(:track, user: user, start_at: 2.days.ago) }
|
|
let!(:track2) { create(:track, user: user, start_at: 1.day.ago) }
|
|
|
|
context 'bulk mode' do
|
|
let(:options) { { mode: :bulk } }
|
|
|
|
it 'cleans existing tracks' do
|
|
expect(user.tracks.count).to eq(2)
|
|
|
|
generator.call
|
|
|
|
expect(user.tracks.count).to eq(0)
|
|
end
|
|
end
|
|
|
|
context 'daily mode' do
|
|
let(:options) { { mode: :daily, start_at: 1.day.ago.beginning_of_day } }
|
|
|
|
it 'preserves existing tracks' do
|
|
expect(user.tracks.count).to eq(2)
|
|
|
|
generator.call
|
|
|
|
# Daily mode should preserve all existing tracks
|
|
remaining_tracks = user.tracks.count
|
|
expect(remaining_tracks).to eq(2)
|
|
end
|
|
end
|
|
|
|
context 'incremental mode' do
|
|
let(:options) { { mode: :incremental } }
|
|
|
|
it 'does not clean existing tracks' do
|
|
expect(user.tracks.count).to eq(2)
|
|
|
|
generator.call
|
|
|
|
expect(user.tracks.count).to eq(2)
|
|
end
|
|
end
|
|
end
|
|
|
|
context 'with time range specified' do
|
|
let(:start_time) { 3.days.ago }
|
|
let(:end_time) { 1.day.ago }
|
|
let(:options) { { start_at: start_time, end_at: end_time, mode: :bulk } }
|
|
let!(:track_in_range) { create(:track, user: user, start_at: 2.days.ago, end_at: 2.days.ago + 1.hour) }
|
|
let!(:track_out_of_range) { create(:track, user: user, start_at: 1.week.ago, end_at: 1.week.ago + 1.hour) }
|
|
|
|
it 'only cleans tracks within the specified range' do
|
|
expect(user.tracks.count).to eq(2)
|
|
|
|
generator.call
|
|
|
|
# Should only clean the track within the time range
|
|
remaining_tracks = user.tracks
|
|
expect(remaining_tracks.count).to eq(1)
|
|
expect(remaining_tracks.first).to eq(track_out_of_range)
|
|
end
|
|
|
|
it 'includes time range in session metadata' do
|
|
result = generator.call
|
|
|
|
session_data = result.get_session_data
|
|
expect(session_data['metadata']['start_at']).to eq(start_time.iso8601)
|
|
expect(session_data['metadata']['end_at']).to eq(end_time.iso8601)
|
|
end
|
|
end
|
|
|
|
context 'job coordination' do
|
|
it 'calculates estimated delay based on chunk count' do
|
|
# Create more points to generate more chunks
|
|
10.times do |i|
|
|
create(:point, user: user, timestamp: (10 - i).days.ago.to_i)
|
|
end
|
|
|
|
expect do
|
|
generator.call
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob)
|
|
.with(user.id, kind_of(String))
|
|
end
|
|
|
|
it 'ensures minimum delay for boundary resolver' do
|
|
# Even with few chunks, should have minimum delay
|
|
expect do
|
|
generator.call
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob)
|
|
.at(be >= 5.minutes.from_now)
|
|
end
|
|
end
|
|
|
|
context 'user settings integration' do
|
|
let(:mock_settings) { double('SafeSettings') }
|
|
|
|
before do
|
|
# Create a proper mock and stub user.safe_settings to return it
|
|
allow(mock_settings).to receive(:minutes_between_routes).and_return(60)
|
|
allow(mock_settings).to receive(:meters_between_routes).and_return(1000)
|
|
allow(user).to receive(:safe_settings).and_return(mock_settings)
|
|
end
|
|
|
|
it 'includes user settings in session metadata' do
|
|
result = generator.call
|
|
|
|
session_data = result.get_session_data
|
|
user_settings = session_data['metadata']['user_settings']
|
|
expect(user_settings['time_threshold_minutes']).to eq(60)
|
|
expect(user_settings['distance_threshold_meters']).to eq(1000)
|
|
expect(user_settings['distance_threshold_behavior']).to eq('ignored_for_frontend_parity')
|
|
end
|
|
|
|
it 'caches user settings' do
|
|
# Call the methods multiple times
|
|
generator.send(:time_threshold_minutes)
|
|
generator.send(:time_threshold_minutes)
|
|
generator.send(:distance_threshold_meters)
|
|
generator.send(:distance_threshold_meters)
|
|
|
|
# Should only call safe_settings once per method due to memoization
|
|
expect(mock_settings).to have_received(:minutes_between_routes).once
|
|
expect(mock_settings).to have_received(:meters_between_routes).once
|
|
end
|
|
end
|
|
end
|
|
|
|
describe 'private methods' do
|
|
describe '#generate_time_chunks' do
|
|
let!(:point1) { create(:point, user: user, timestamp: 2.days.ago.to_i) }
|
|
let!(:point2) { create(:point, user: user, timestamp: 1.day.ago.to_i) }
|
|
|
|
it 'creates TimeChunker with correct parameters' do
|
|
expect(Tracks::TimeChunker).to receive(:new)
|
|
.with(user, start_at: nil, end_at: nil, chunk_size: 1.day)
|
|
.and_call_original
|
|
|
|
generator.send(:generate_time_chunks)
|
|
end
|
|
|
|
it 'returns chunks from TimeChunker' do
|
|
chunks = generator.send(:generate_time_chunks)
|
|
expect(chunks).to be_an(Array)
|
|
expect(chunks).not_to be_empty
|
|
end
|
|
end
|
|
|
|
describe '#enqueue_chunk_jobs' do
|
|
let(:session_id) { 'test-session' }
|
|
let(:chunks) do
|
|
[
|
|
{ chunk_id: 'chunk1', start_timestamp: 1.day.ago.to_i },
|
|
{ chunk_id: 'chunk2', start_timestamp: 2.days.ago.to_i }
|
|
]
|
|
end
|
|
|
|
it 'enqueues job for each chunk' do
|
|
expect do
|
|
generator.send(:enqueue_chunk_jobs, session_id, chunks)
|
|
end.to have_enqueued_job(Tracks::TimeChunkProcessorJob)
|
|
.exactly(2).times
|
|
end
|
|
|
|
it 'passes correct parameters to each job' do
|
|
expect(Tracks::TimeChunkProcessorJob).to receive(:perform_later)
|
|
.with(user.id, session_id, chunks[0])
|
|
expect(Tracks::TimeChunkProcessorJob).to receive(:perform_later)
|
|
.with(user.id, session_id, chunks[1])
|
|
|
|
generator.send(:enqueue_chunk_jobs, session_id, chunks)
|
|
end
|
|
end
|
|
|
|
describe '#enqueue_boundary_resolver' do
|
|
let(:session_id) { 'test-session' }
|
|
|
|
it 'enqueues boundary resolver with estimated delay' do
|
|
expect do
|
|
generator.send(:enqueue_boundary_resolver, session_id, 5)
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob)
|
|
.with(user.id, session_id)
|
|
.at(be >= 2.minutes.from_now)
|
|
end
|
|
|
|
it 'uses minimum delay for small chunk counts' do
|
|
expect do
|
|
generator.send(:enqueue_boundary_resolver, session_id, 1)
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob)
|
|
.at(be >= 5.minutes.from_now)
|
|
end
|
|
|
|
it 'scales delay with chunk count' do
|
|
expect do
|
|
generator.send(:enqueue_boundary_resolver, session_id, 20)
|
|
end.to have_enqueued_job(Tracks::BoundaryResolverJob)
|
|
.at(be >= 10.minutes.from_now)
|
|
end
|
|
end
|
|
|
|
describe 'time range handling' do
|
|
let(:start_time) { 3.days.ago }
|
|
let(:end_time) { 1.day.ago }
|
|
let(:generator) { described_class.new(user, start_at: start_time, end_at: end_time) }
|
|
|
|
describe '#time_range_defined?' do
|
|
it 'returns true when start_at or end_at is defined' do
|
|
expect(generator.send(:time_range_defined?)).to be true
|
|
end
|
|
|
|
it 'returns false when neither is defined' do
|
|
generator = described_class.new(user)
|
|
expect(generator.send(:time_range_defined?)).to be false
|
|
end
|
|
end
|
|
|
|
describe '#time_range' do
|
|
it 'creates proper time range when both defined' do
|
|
range = generator.send(:time_range)
|
|
expect(range.begin).to eq(Time.zone.at(start_time.to_i))
|
|
expect(range.end).to eq(Time.zone.at(end_time.to_i))
|
|
end
|
|
|
|
it 'creates open-ended range when only start defined' do
|
|
generator = described_class.new(user, start_at: start_time)
|
|
range = generator.send(:time_range)
|
|
expect(range.begin).to eq(Time.zone.at(start_time.to_i))
|
|
expect(range.end).to be_nil
|
|
end
|
|
|
|
it 'creates range with open beginning when only end defined' do
|
|
generator = described_class.new(user, end_at: end_time)
|
|
range = generator.send(:time_range)
|
|
expect(range.begin).to be_nil
|
|
expect(range.end).to eq(Time.zone.at(end_time.to_i))
|
|
end
|
|
end
|
|
|
|
describe '#daily_time_range' do
|
|
let(:day) { 2.days.ago.to_date }
|
|
let(:generator) { described_class.new(user, start_at: day) }
|
|
|
|
it 'creates range for entire day' do
|
|
range = generator.send(:daily_time_range)
|
|
expect(range.begin).to eq(day.beginning_of_day.to_i)
|
|
expect(range.end).to eq(day.end_of_day.to_i)
|
|
end
|
|
|
|
it 'uses current date when start_at not provided' do
|
|
generator = described_class.new(user)
|
|
range = generator.send(:daily_time_range)
|
|
expect(range.begin).to eq(Date.current.beginning_of_day.to_i)
|
|
expect(range.end).to eq(Date.current.end_of_day.to_i)
|
|
end
|
|
end
|
|
end
|
|
end
|
|
end
|