mirror of
https://github.com/Freika/dawarich.git
synced 2026-01-11 17:51:39 -05:00
* fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements * Pull only necessary data for map v2 points * Feature/raw data archive (#2009) * 0.36.2 (#2007) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Remove esbuild scripts from package.json * Remove sideEffects field from package.json * Raw data archivation * Add tests * Fix tests * Fix tests * Update ExceptionReporter * Add schedule to run raw data archival job monthly * Change file structure for raw data archival feature * Update changelog and version for raw data archival feature --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Set raw_data to an empty hash instead of nil when archiving * Fix storage configuration and file extraction * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018) * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation * Remove raw data from visited cities api endpoint * Use user timezone to show dates on maps (#2020) * Fix/pre epoch time (#2019) * Use user timezone to show dates on maps * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Fix tests failing due to new index on stats table * Fix failing specs * Update redis client configuration to support unix socket connection * Update changelog * Fix kml kmz import issues (#2023) * Fix kml kmz import issues * Refactor KML importer to improve readability and maintainability * Implement moving points in map v2 and fix route rendering logic to ma… (#2027) * Implement moving points in map v2 and fix route rendering logic to match map v1. * Fix route spec * fix(maplibre): update date format to ISO 8601 (#2029) * Add verification step to raw data archival process (#2028) * Add verification step to raw data archival process * Add actual verification of raw data archives after creation, and only clear raw_data for verified archives. * Fix failing specs * Eliminate zip-bomb risk * Fix potential memory leak in js * Return .keep files * Use Toast instead of alert for notifications * Add help section to navbar dropdown * Update changelog * Remove raw_data_archival_job * Ensure file is being closed properly after reading in Archivable concern * Add composite index to stats table if not exists * Update changelog * Update entrypoint to always sync static assets (not only new ones) * Add family layer to MapLibre maps (#2055) * Add family layer to MapLibre maps * Update migration * Don't show family toggle if feature is disabled * Update changelog * Return changelog * Update changelog * Update tailwind file * Bump sentry-rails from 6.0.0 to 6.1.0 (#1945) Bumps [sentry-rails](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.1.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.1.0) --- updated-dependencies: - dependency-name: sentry-rails dependency-version: 6.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump turbo-rails from 2.0.17 to 2.0.20 (#1944) Bumps [turbo-rails](https://github.com/hotwired/turbo-rails) from 2.0.17 to 2.0.20. - [Release notes](https://github.com/hotwired/turbo-rails/releases) - [Commits](https://github.com/hotwired/turbo-rails/compare/v2.0.17...v2.0.20) --- updated-dependencies: - dependency-name: turbo-rails dependency-version: 2.0.20 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump webmock from 3.25.1 to 3.26.1 (#1943) Bumps [webmock](https://github.com/bblimke/webmock) from 3.25.1 to 3.26.1. - [Release notes](https://github.com/bblimke/webmock/releases) - [Changelog](https://github.com/bblimke/webmock/blob/master/CHANGELOG.md) - [Commits](https://github.com/bblimke/webmock/compare/v3.25.1...v3.26.1) --- updated-dependencies: - dependency-name: webmock dependency-version: 3.26.1 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump brakeman from 7.1.0 to 7.1.1 (#1942) Bumps [brakeman](https://github.com/presidentbeef/brakeman) from 7.1.0 to 7.1.1. - [Release notes](https://github.com/presidentbeef/brakeman/releases) - [Changelog](https://github.com/presidentbeef/brakeman/blob/main/CHANGES.md) - [Commits](https://github.com/presidentbeef/brakeman/compare/v7.1.0...v7.1.1) --- updated-dependencies: - dependency-name: brakeman dependency-version: 7.1.1 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump redis from 5.4.0 to 5.4.1 (#1941) Bumps [redis](https://github.com/redis/redis-rb) from 5.4.0 to 5.4.1. - [Changelog](https://github.com/redis/redis-rb/blob/master/CHANGELOG.md) - [Commits](https://github.com/redis/redis-rb/compare/v5.4.0...v5.4.1) --- updated-dependencies: - dependency-name: redis dependency-version: 5.4.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Put import deletion into background job (#2045) * Put import deletion into background job * Update changelog * fix null type error and update heatmap styling (#2037) * fix: use constant weight for maplibre heatmap layer * fix null type, update heatmap styling * improve heatmap styling * fix typo * Fix stats calculation to recursively reduce H3 resolution when too ma… (#2065) * Fix stats calculation to recursively reduce H3 resolution when too many hexagons are generated * Update CHANGELOG.md * Validate trip start and end dates (#2066) * Validate trip start and end dates * Update changelog * Update migration to clean up duplicate stats before adding unique index * Fix fog of war radius setting being ignored and applying settings causing errors (#2068) * Update changelog * Add Rack::Deflater middleware to config/application.rb to enable gzip compression for responses. * Add composite index to points on user_id and timestamp * Deduplicte points based on timestamp brought to unix time * Fix/stats cache invalidation (#2072) * Fix family layer toggle in Map v2 settings for non-selfhosted env * Invalidate cache * Remove comments * Remove comment * Add new indicies to improve performance and remove unused ones to opt… (#2078) * Add new indicies to improve performance and remove unused ones to optimize database. * Remove comments * Update map search suggestions panel styling * Add yearly digest (#2073) * Add yearly digest * Rename YearlyDigests to Users::Digests * Minor changes * Update yearly digest layout and styles * Add flags and chart to email * Update colors * Fix layout of stats in yearly digest view * Remove cron job for yearly digest scheduling * Update CHANGELOG.md * Update digest email setting handling * Allow sharing digest for 1 week or 1 month * Change Digests Distance to Bigint * Fix settings page * Update changelog * Add RailsPulse (#2079) * Add RailsPulse * Add RailsPulse monitoring tool with basic HTTP authentication * Bring points_count to integer * Update migration and version * Update rubocop issues * Fix migrations and data verification to remove safety_assured blocks and handle missing points gracefully. * Update version * Update calculation of time spent in a country for year-end digest email (#2110) * Update calculation of time spent in a country for year-end digest email * Add a filter to exclude raw data points when calculating yearly digests. * Bump trix from 2.1.15 to 2.1.16 in the npm_and_yarn group across 1 directory (#2098) * 0.37.1 (#2092) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements * Pull only necessary data for map v2 points * Feature/raw data archive (#2009) * 0.36.2 (#2007) * fix: move foreman to global gems to fix startup crash (#1971) * Update exporting code to stream points data to file in batches to red… (#1980) * Update exporting code to stream points data to file in batches to reduce memory usage * Update changelog * Update changelog * Feature/maplibre frontend (#1953) * Add a plan to use MapLibre GL JS for the frontend map rendering, replacing Leaflet * Implement phase 1 * Phases 1-3 + part of 4 * Fix e2e tests * Phase 6 * Implement fog of war * Phase 7 * Next step: fix specs, phase 7 done * Use our own map tiles * Extract v2 map logic to separate manager classes * Update settings panel on v2 map * Update v2 e2e tests structure * Reimplement location search in maps v2 * Update speed routes * Implement visits and places creation in v2 * Fix last failing test * Implement visits merging * Fix a routes e2e test and simplify the routes layer styling. * Extract js to modules from maps_v2_controller.js * Implement area creation * Fix spec problem * Fix some e2e tests * Implement live mode in v2 map * Update icons and panel * Extract some styles * Remove unused file * Start adding dark theme to popups on MapLibre maps * Make popups respect dark theme * Move v2 maps to maplibre namespace * Update v2 references to maplibre * Put place, area and visit info into side panel * Update API to use safe settings config method * Fix specs * Fix method name to config in SafeSettings and update usages accordingly * Add missing public files * Add handling for real time points * Fix remembering enabled/disabled layers of the v2 map * Fix lots of e2e tests * Add settings to select map version * Use maps/v2 as main path for MapLibre maps * Update routing * Update live mode * Update maplibre controller * Update changelog * Remove some console.log statements --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Remove esbuild scripts from package.json * Remove sideEffects field from package.json * Raw data archivation * Add tests * Fix tests * Fix tests * Update ExceptionReporter * Add schedule to run raw data archival job monthly * Change file structure for raw data archival feature * Update changelog and version for raw data archival feature --------- Co-authored-by: Robin Tuszik <mail@robin.gg> * Set raw_data to an empty hash instead of nil when archiving * Fix storage configuration and file extraction * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation (#2018) * Consider MIN_MINUTES_SPENT_IN_CITY during stats calculation * Remove raw data from visited cities api endpoint * Use user timezone to show dates on maps (#2020) * Fix/pre epoch time (#2019) * Use user timezone to show dates on maps * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Limit timestamps to valid range to prevent database errors when users enter pre-epoch dates. * Fix tests failing due to new index on stats table * Fix failing specs * Update redis client configuration to support unix socket connection * Update changelog * Fix kml kmz import issues (#2023) * Fix kml kmz import issues * Refactor KML importer to improve readability and maintainability * Implement moving points in map v2 and fix route rendering logic to ma… (#2027) * Implement moving points in map v2 and fix route rendering logic to match map v1. * Fix route spec * fix(maplibre): update date format to ISO 8601 (#2029) * Add verification step to raw data archival process (#2028) * Add verification step to raw data archival process * Add actual verification of raw data archives after creation, and only clear raw_data for verified archives. * Fix failing specs * Eliminate zip-bomb risk * Fix potential memory leak in js * Return .keep files * Use Toast instead of alert for notifications * Add help section to navbar dropdown * Update changelog * Remove raw_data_archival_job * Ensure file is being closed properly after reading in Archivable concern * Add composite index to stats table if not exists * Update changelog * Update entrypoint to always sync static assets (not only new ones) * Add family layer to MapLibre maps (#2055) * Add family layer to MapLibre maps * Update migration * Don't show family toggle if feature is disabled * Update changelog * Return changelog * Update changelog * Update tailwind file * Bump sentry-rails from 6.0.0 to 6.1.0 (#1945) Bumps [sentry-rails](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.1.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.1.0) --- updated-dependencies: - dependency-name: sentry-rails dependency-version: 6.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump turbo-rails from 2.0.17 to 2.0.20 (#1944) Bumps [turbo-rails](https://github.com/hotwired/turbo-rails) from 2.0.17 to 2.0.20. - [Release notes](https://github.com/hotwired/turbo-rails/releases) - [Commits](https://github.com/hotwired/turbo-rails/compare/v2.0.17...v2.0.20) --- updated-dependencies: - dependency-name: turbo-rails dependency-version: 2.0.20 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump webmock from 3.25.1 to 3.26.1 (#1943) Bumps [webmock](https://github.com/bblimke/webmock) from 3.25.1 to 3.26.1. - [Release notes](https://github.com/bblimke/webmock/releases) - [Changelog](https://github.com/bblimke/webmock/blob/master/CHANGELOG.md) - [Commits](https://github.com/bblimke/webmock/compare/v3.25.1...v3.26.1) --- updated-dependencies: - dependency-name: webmock dependency-version: 3.26.1 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump brakeman from 7.1.0 to 7.1.1 (#1942) Bumps [brakeman](https://github.com/presidentbeef/brakeman) from 7.1.0 to 7.1.1. - [Release notes](https://github.com/presidentbeef/brakeman/releases) - [Changelog](https://github.com/presidentbeef/brakeman/blob/main/CHANGES.md) - [Commits](https://github.com/presidentbeef/brakeman/compare/v7.1.0...v7.1.1) --- updated-dependencies: - dependency-name: brakeman dependency-version: 7.1.1 dependency-type: direct:development update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump redis from 5.4.0 to 5.4.1 (#1941) Bumps [redis](https://github.com/redis/redis-rb) from 5.4.0 to 5.4.1. - [Changelog](https://github.com/redis/redis-rb/blob/master/CHANGELOG.md) - [Commits](https://github.com/redis/redis-rb/compare/v5.4.0...v5.4.1) --- updated-dependencies: - dependency-name: redis dependency-version: 5.4.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Put import deletion into background job (#2045) * Put import deletion into background job * Update changelog * fix null type error and update heatmap styling (#2037) * fix: use constant weight for maplibre heatmap layer * fix null type, update heatmap styling * improve heatmap styling * fix typo * Fix stats calculation to recursively reduce H3 resolution when too ma… (#2065) * Fix stats calculation to recursively reduce H3 resolution when too many hexagons are generated * Update CHANGELOG.md * Validate trip start and end dates (#2066) * Validate trip start and end dates * Update changelog * Update migration to clean up duplicate stats before adding unique index * Fix fog of war radius setting being ignored and applying settings causing errors (#2068) * Update changelog * Add Rack::Deflater middleware to config/application.rb to enable gzip compression for responses. * Add composite index to points on user_id and timestamp * Deduplicte points based on timestamp brought to unix time * Fix/stats cache invalidation (#2072) * Fix family layer toggle in Map v2 settings for non-selfhosted env * Invalidate cache * Remove comments * Remove comment * Add new indicies to improve performance and remove unused ones to opt… (#2078) * Add new indicies to improve performance and remove unused ones to optimize database. * Remove comments * Update map search suggestions panel styling * Add yearly digest (#2073) * Add yearly digest * Rename YearlyDigests to Users::Digests * Minor changes * Update yearly digest layout and styles * Add flags and chart to email * Update colors * Fix layout of stats in yearly digest view * Remove cron job for yearly digest scheduling * Update CHANGELOG.md * Update digest email setting handling * Allow sharing digest for 1 week or 1 month * Change Digests Distance to Bigint * Fix settings page * Update changelog * Add RailsPulse (#2079) * Add RailsPulse * Add RailsPulse monitoring tool with basic HTTP authentication * Bring points_count to integer * Update migration and version * Update rubocop issues * Fix migrations and data verification to remove safety_assured blocks and handle missing points gracefully. * Update version --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump trix in the npm_and_yarn group across 1 directory Bumps the npm_and_yarn group with 1 update in the / directory: [trix](https://github.com/basecamp/trix). Updates `trix` from 2.1.15 to 2.1.16 - [Release notes](https://github.com/basecamp/trix/releases) - [Commits](https://github.com/basecamp/trix/compare/v2.1.15...v2.1.16) --- updated-dependencies: - dependency-name: trix dependency-version: 2.1.16 dependency-type: direct:production dependency-group: npm_and_yarn ... Signed-off-by: dependabot[bot] <support@github.com> --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Map v2 will no longer block the UI when Immich/Photoprism integration has a bad URL or is unreachable (#2113) * Bump rubocop-rails from 2.33.4 to 2.34.2 (#2080) Bumps [rubocop-rails](https://github.com/rubocop/rubocop-rails) from 2.33.4 to 2.34.2. - [Release notes](https://github.com/rubocop/rubocop-rails/releases) - [Changelog](https://github.com/rubocop/rubocop-rails/blob/master/CHANGELOG.md) - [Commits](https://github.com/rubocop/rubocop-rails/compare/v2.33.4...v2.34.2) --- updated-dependencies: - dependency-name: rubocop-rails dependency-version: 2.34.2 dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump chartkick from 5.2.0 to 5.2.1 (#2081) Bumps [chartkick](https://github.com/ankane/chartkick) from 5.2.0 to 5.2.1. - [Changelog](https://github.com/ankane/chartkick/blob/master/CHANGELOG.md) - [Commits](https://github.com/ankane/chartkick/compare/v5.2.0...v5.2.1) --- updated-dependencies: - dependency-name: chartkick dependency-version: 5.2.1 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump rubyzip from 3.2.0 to 3.2.2 (#2082) Bumps [rubyzip](https://github.com/rubyzip/rubyzip) from 3.2.0 to 3.2.2. - [Release notes](https://github.com/rubyzip/rubyzip/releases) - [Changelog](https://github.com/rubyzip/rubyzip/blob/main/Changelog.md) - [Commits](https://github.com/rubyzip/rubyzip/compare/v3.2.0...v3.2.2) --- updated-dependencies: - dependency-name: rubyzip dependency-version: 3.2.2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump sentry-ruby from 6.0.0 to 6.2.0 (#2083) Bumps [sentry-ruby](https://github.com/getsentry/sentry-ruby) from 6.0.0 to 6.2.0. - [Release notes](https://github.com/getsentry/sentry-ruby/releases) - [Changelog](https://github.com/getsentry/sentry-ruby/blob/master/CHANGELOG.md) - [Commits](https://github.com/getsentry/sentry-ruby/compare/6.0.0...6.2.0) --- updated-dependencies: - dependency-name: sentry-ruby dependency-version: 6.2.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Bump sidekiq from 8.0.8 to 8.1.0 (#2084) Bumps [sidekiq](https://github.com/sidekiq/sidekiq) from 8.0.8 to 8.1.0. - [Changelog](https://github.com/sidekiq/sidekiq/blob/main/Changes.md) - [Commits](https://github.com/sidekiq/sidekiq/compare/v8.0.8...v8.1.0) --- updated-dependencies: - dependency-name: sidekiq dependency-version: 8.1.0 dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Evgenii Burmakin <Freika@users.noreply.github.com> * Update digest calculation to use actual time spent in countries based… (#2115) * Update digest calculation to use actual time spent in countries based on consecutive points, avoiding double-counting days when crossing borders. * Move methods to private * Update Gemfile and Gemfile.lock to pin connection_pool and sidekiq versions * Rework country tracked days calculation * Adjust calculate_duration_in_minutes to only count continuous presence within cities, excluding long gaps. * Move helpers for digest city progress to a helper method * Implement globe projection option for Map v2 using MapLibre GL JS. * Update time spent calculation for country minutes in user digests * Stats are now calculated with more accuracy by storing total minutes spent per country. * Add globe_projection setting to safe settings * Remove console.logs from most of map v2 * Implement some performance improvements and caching for various featu… (#2133) * Implement some performance improvements and caching for various features. * Fix failing tests * Implement routes behaviour in map v2 to match map v1 * Fix route highlighting * Add fallbacks when retrieving full route features to handle cases where source data access methods vary. * Fix some e2e tests * Add immediate verification and count validation to raw data archiving (#2138) * Add immediate verification and count validation to raw data archiving * Remove verifying job * Add archive metrics reporting * Disable RailsPulse in Self-hosted Environments * Remove user_id and points_count parameters from Metrics::Archives::Operation and related calls. * Move points creation logic from background jobs to service objects (#2145) * Move points creation logic from background jobs to service objects * Remove unused point creation jobs * Update changelog * Add tracks to map v2 (#2142) * Add tracks to map v2 * Remove console log * Update tracks generation behavior to ignore distance threshold for frontend parity * Extract logic to services from TracksController#index and add tests * Move query logic for track listing into a service object. * Minor changes * Fix minor issues --------- Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Robin Tuszik <mail@robin.gg> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
431 lines
14 KiB
Ruby
431 lines
14 KiB
Ruby
# frozen_string_literal: true
|
||
|
||
namespace :demo do
|
||
desc 'Seed demo data: user, points from GeoJSON, visits, and areas'
|
||
task :seed_data, [:geojson_path] => :environment do |_t, args|
|
||
geojson_path = args[:geojson_path] || Rails.root.join('tmp/demo_data.geojson').to_s
|
||
|
||
unless File.exist?(geojson_path)
|
||
puts "Error: GeoJSON file not found at #{geojson_path}"
|
||
puts 'Usage: rake demo:seed_data[path/to/file.geojson]'
|
||
puts 'Or place file at tmp/demo_data.geojson'
|
||
exit 1
|
||
end
|
||
|
||
puts '🚀 Starting demo data generation...'
|
||
puts '=' * 60
|
||
|
||
# 1. Create demo user
|
||
puts "\n📝 Creating demo user..."
|
||
user = User.find_or_initialize_by(email: 'demo@dawarich.app')
|
||
|
||
if user.new_record?
|
||
user.password = 'password'
|
||
user.password_confirmation = 'password'
|
||
user.save!
|
||
user.update!(status: :active, active_until: 1000.years.from_now)
|
||
puts "✅ User created: #{user.email}"
|
||
puts ' Password: password'
|
||
puts " API Key: #{user.api_key}"
|
||
else
|
||
puts "ℹ️ User already exists: #{user.email}"
|
||
end
|
||
|
||
# 2. Import GeoJSON data
|
||
puts "\n📍 Importing GeoJSON data from #{geojson_path}..."
|
||
import = user.imports.create!(
|
||
name: "Demo Data Import - #{Time.current.strftime('%Y-%m-%d %H:%M')}",
|
||
source: :geojson
|
||
)
|
||
|
||
begin
|
||
Geojson::Importer.new(import, user.id, geojson_path).call
|
||
import.update!(status: :completed)
|
||
points_count = user.points.count
|
||
puts "✅ Imported #{points_count} points"
|
||
rescue StandardError => e
|
||
import.update!(status: :failed)
|
||
puts "❌ Import failed: #{e.message}"
|
||
exit 1
|
||
end
|
||
|
||
# Check if points were imported
|
||
points_count = Point.where(user_id: user.id).count
|
||
|
||
if points_count.zero?
|
||
puts '❌ No points found after import. Cannot create visits and areas.'
|
||
exit 1
|
||
end
|
||
|
||
# 3. Create suggested visits
|
||
puts "\n🏠 Creating 50 suggested visits..."
|
||
created_suggested = create_visits(user, 50, :suggested)
|
||
puts "✅ Created #{created_suggested} suggested visits"
|
||
|
||
# 4. Create confirmed visits
|
||
puts "\n✅ Creating 50 confirmed visits..."
|
||
created_confirmed = create_visits(user, 50, :confirmed)
|
||
puts "✅ Created #{created_confirmed} confirmed visits"
|
||
|
||
# 5. Create areas
|
||
puts "\n📍 Creating 10 areas..."
|
||
created_areas = create_areas(user, 10)
|
||
puts "✅ Created #{created_areas} areas"
|
||
|
||
# 6. Create tracks
|
||
puts "\n🛤️ Creating 20 tracks..."
|
||
created_tracks = create_tracks(user, 20)
|
||
puts "✅ Created #{created_tracks} tracks"
|
||
|
||
# 7. Create family with members
|
||
puts "\n👨👩👧👦 Creating demo family..."
|
||
family_members = create_family_with_members(user)
|
||
puts "✅ Created family with #{family_members.count} members"
|
||
|
||
puts "\n" + '=' * 60
|
||
puts '🎉 Demo data generation complete!'
|
||
puts '=' * 60
|
||
puts "\n📊 Summary:"
|
||
puts " User: #{user.email}"
|
||
puts " Points: #{Point.where(user_id: user.id).count}"
|
||
puts " Places: #{user.visits.joins(:place).select('DISTINCT places.id').count}"
|
||
puts " Suggested Visits: #{user.visits.suggested.count}"
|
||
puts " Confirmed Visits: #{user.visits.confirmed.count}"
|
||
puts " Areas: #{user.areas.count}"
|
||
puts " Tracks: #{user.tracks.count}"
|
||
puts " Family Members: #{family_members.count}"
|
||
puts "\n🔐 Login credentials:"
|
||
puts ' Email: demo@dawarich.app'
|
||
puts ' Password: password'
|
||
puts "\n👨👩👧👦 Family member credentials:"
|
||
family_members.each_with_index do |member, index|
|
||
puts " Member #{index + 1}: #{member.email} / password"
|
||
end
|
||
end
|
||
|
||
def create_visits(user, count, status)
|
||
area_names = [
|
||
'Home', 'Work', 'Gym', 'Coffee Shop', 'Restaurant',
|
||
'Park', 'Library', 'Shopping Mall', 'Friend\'s House',
|
||
'Doctor\'s Office', 'Supermarket', 'School', 'Cinema',
|
||
'Beach', 'Museum', 'Airport', 'Train Station', 'Hotel'
|
||
]
|
||
|
||
# Get random points, excluding already used ones
|
||
used_point_ids = user.visits.pluck(:id).flat_map { |v| Visit.find(v).points.pluck(:id) }.uniq
|
||
available_points = Point.where(user_id: user.id).where.not(id: used_point_ids).order('RANDOM()').limit(count * 2)
|
||
|
||
if available_points.empty?
|
||
puts "⚠️ No available points for #{status} visits"
|
||
return 0
|
||
end
|
||
|
||
created_count = 0
|
||
available_points.first(count).each_with_index do |point, index|
|
||
# Random duration between 1-6 hours
|
||
duration_hours = rand(1..6)
|
||
started_at = point.recorded_at
|
||
ended_at = started_at + duration_hours.hours
|
||
|
||
# Create or find a place at this location
|
||
# Round coordinates to 5 decimal places (~1 meter precision)
|
||
rounded_lat = point.lat.round(5)
|
||
rounded_lon = point.lon.round(5)
|
||
|
||
place = Place.find_or_initialize_by(
|
||
latitude: rounded_lat,
|
||
longitude: rounded_lon
|
||
)
|
||
|
||
if place.new_record?
|
||
place.name = area_names.sample
|
||
place.lonlat = "POINT(#{rounded_lon} #{rounded_lat})"
|
||
place.save!
|
||
end
|
||
|
||
# Create visit with place
|
||
visit = user.visits.create!(
|
||
name: place.name,
|
||
place: place,
|
||
started_at: started_at,
|
||
ended_at: ended_at,
|
||
duration: (ended_at - started_at).to_i,
|
||
status: status
|
||
)
|
||
|
||
# Associate the point with the visit
|
||
point.update!(visit: visit)
|
||
|
||
# Find nearby points within 100 meters and associate them
|
||
nearby_points = Point.where(user_id: user.id)
|
||
.where.not(id: point.id)
|
||
.where.not(id: used_point_ids)
|
||
.where('timestamp BETWEEN ? AND ?', started_at.to_i, ended_at.to_i)
|
||
.select { |p| distance_between(point, p) < 100 }
|
||
.first(10)
|
||
|
||
nearby_points.each do |nearby_point|
|
||
nearby_point.update!(visit: visit)
|
||
used_point_ids << nearby_point.id
|
||
end
|
||
|
||
created_count += 1
|
||
print '.' if (index + 1) % 10 == 0
|
||
end
|
||
|
||
puts '' if created_count > 0
|
||
created_count
|
||
end
|
||
|
||
def create_areas(user, count)
|
||
area_names = [
|
||
'Home', 'Work', 'Gym', 'Parents House', 'Favorite Restaurant',
|
||
'Coffee Shop', 'Park', 'Library', 'Shopping Center', 'Friend\'s Place'
|
||
]
|
||
|
||
# Get random points spread across the dataset
|
||
total_points = Point.where(user_id: user.id).count
|
||
step = [total_points / count, 1].max
|
||
sample_points = Point.where(user_id: user.id).order(:timestamp).each_slice(step).map(&:first).first(count)
|
||
|
||
created_count = 0
|
||
sample_points.each_with_index do |point, index|
|
||
# Random radius between 50-500 meters
|
||
radius = rand(50..500)
|
||
|
||
user.areas.create!(
|
||
name: area_names[index] || "Area #{index + 1}",
|
||
latitude: point.lat,
|
||
longitude: point.lon,
|
||
radius: radius
|
||
)
|
||
|
||
created_count += 1
|
||
end
|
||
|
||
created_count
|
||
end
|
||
|
||
def distance_between(point1, point2)
|
||
# Haversine formula to calculate distance in meters
|
||
lat1 = point1.lat
|
||
lon1 = point1.lon
|
||
lat2 = point2.lat
|
||
lon2 = point2.lon
|
||
|
||
rad_per_deg = Math::PI / 180
|
||
rkm = 6371 # Earth radius in kilometers
|
||
rm = rkm * 1000 # Earth radius in meters
|
||
|
||
dlat_rad = (lat2 - lat1) * rad_per_deg
|
||
dlon_rad = (lon2 - lon1) * rad_per_deg
|
||
|
||
lat1_rad = lat1 * rad_per_deg
|
||
lat2_rad = lat2 * rad_per_deg
|
||
|
||
a = Math.sin(dlat_rad / 2)**2 + Math.cos(lat1_rad) * Math.cos(lat2_rad) * Math.sin(dlon_rad / 2)**2
|
||
c = 2 * Math.atan2(Math.sqrt(a), Math.sqrt(1 - a))
|
||
|
||
rm * c # Distance in meters
|
||
end
|
||
|
||
def create_family_with_members(owner)
|
||
# Create or find family
|
||
family = Family.find_or_initialize_by(creator: owner)
|
||
|
||
if family.new_record?
|
||
family.name = 'Demo Family'
|
||
family.save!
|
||
puts " Created family: #{family.name}"
|
||
else
|
||
puts " ℹ️ Family already exists: #{family.name}"
|
||
end
|
||
|
||
# Create or find owner membership
|
||
owner_membership = Family::Membership.find_or_create_by!(
|
||
family: family,
|
||
user: owner,
|
||
role: :owner
|
||
)
|
||
|
||
# Create 3 family members with location data
|
||
member_emails = [
|
||
'family.member1@dawarich.app',
|
||
'family.member2@dawarich.app',
|
||
'family.member3@dawarich.app'
|
||
]
|
||
|
||
family_members = []
|
||
|
||
# Get some sample points from the owner's data to create realistic locations
|
||
sample_points = Point.where(user_id: owner.id).order('RANDOM()').limit(10)
|
||
|
||
member_emails.each_with_index do |email, index|
|
||
# Create or find family member user
|
||
member = User.find_or_initialize_by(email: email)
|
||
|
||
if member.new_record?
|
||
member.password = 'password'
|
||
member.password_confirmation = 'password'
|
||
member.save!
|
||
member.update!(status: :active, active_until: 1000.years.from_now)
|
||
puts " Created family member: #{member.email}"
|
||
else
|
||
puts " ℹ️ Family member already exists: #{member.email}"
|
||
end
|
||
|
||
# Add member to family
|
||
Family::Membership.find_or_create_by!(
|
||
family: family,
|
||
user: member,
|
||
role: :member
|
||
)
|
||
|
||
# Enable location sharing for this member (permanent)
|
||
member.update_family_location_sharing!(true, duration: 'permanent')
|
||
|
||
# Create some points for this family member near owner's locations
|
||
if sample_points.any?
|
||
# Get a different sample point for each member
|
||
base_point = sample_points[index % sample_points.length]
|
||
|
||
# Create 3-5 recent points for this member within 1km of base location
|
||
points_count = rand(3..5)
|
||
|
||
points_count.times do |point_index|
|
||
# Add random offset (within ~1km)
|
||
lat_offset = (rand(-0.01..0.01) * 100) / 100.0
|
||
lon_offset = (rand(-0.01..0.01) * 100) / 100.0
|
||
|
||
# Calculate new coordinates
|
||
lat = base_point.lat + lat_offset
|
||
lon = base_point.lon + lon_offset
|
||
|
||
# Create point with recent timestamp (last 24 hours)
|
||
timestamp = (Time.current - rand(0..24).hours).to_i
|
||
|
||
Point.create!(
|
||
user: member,
|
||
latitude: lat,
|
||
longitude: lon,
|
||
lonlat: "POINT(#{lon} #{lat})",
|
||
timestamp: timestamp,
|
||
altitude: base_point.altitude || 0,
|
||
velocity: rand(0..50),
|
||
battery: rand(20..100),
|
||
battery_status: %w[charging connected_not_charging full].sample,
|
||
tracker_id: "demo_tracker_#{member.id}",
|
||
import_id: nil
|
||
)
|
||
end
|
||
|
||
puts " Created #{points_count} location points for #{member.email}"
|
||
end
|
||
|
||
family_members << member
|
||
end
|
||
|
||
family_members
|
||
end
|
||
|
||
def create_tracks(user, count)
|
||
# Get points that aren't already assigned to tracks
|
||
available_points = Point.where(user_id: user.id, track_id: nil)
|
||
.order(:timestamp)
|
||
|
||
if available_points.count < 10
|
||
puts " ⚠️ Not enough untracked points to create tracks"
|
||
return 0
|
||
end
|
||
|
||
created_count = 0
|
||
points_per_track = [available_points.count / count, 10].max
|
||
|
||
count.times do |index|
|
||
# Get a segment of consecutive points
|
||
offset = index * points_per_track
|
||
track_points = available_points.offset(offset).limit(points_per_track).to_a
|
||
|
||
break if track_points.length < 2
|
||
|
||
# Sort by timestamp to ensure proper ordering
|
||
track_points = track_points.sort_by(&:timestamp)
|
||
|
||
# Build LineString from points
|
||
coordinates = track_points.map { |p| [p.lon, p.lat] }
|
||
linestring_wkt = "LINESTRING(#{coordinates.map { |lon, lat| "#{lon} #{lat}" }.join(', ')})"
|
||
|
||
# Calculate track metadata
|
||
start_at = Time.zone.at(track_points.first.timestamp)
|
||
end_at = Time.zone.at(track_points.last.timestamp)
|
||
duration = (end_at - start_at).to_i
|
||
|
||
# Calculate total distance
|
||
total_distance = 0
|
||
track_points.each_cons(2) do |p1, p2|
|
||
total_distance += haversine_distance(p1.lat, p1.lon, p2.lat, p2.lon)
|
||
end
|
||
|
||
# Calculate average speed (m/s)
|
||
avg_speed = duration > 0 ? (total_distance / duration.to_f) : 0
|
||
|
||
# Calculate elevation data
|
||
elevations = track_points.map(&:altitude).compact
|
||
elevation_gain = 0
|
||
elevation_loss = 0
|
||
elevation_max = elevations.any? ? elevations.max : 0
|
||
elevation_min = elevations.any? ? elevations.min : 0
|
||
|
||
if elevations.length > 1
|
||
elevations.each_cons(2) do |alt1, alt2|
|
||
diff = alt2 - alt1
|
||
if diff > 0
|
||
elevation_gain += diff
|
||
else
|
||
elevation_loss += diff.abs
|
||
end
|
||
end
|
||
end
|
||
|
||
# Create the track
|
||
track = user.tracks.create!(
|
||
start_at: start_at,
|
||
end_at: end_at,
|
||
distance: total_distance,
|
||
avg_speed: avg_speed,
|
||
duration: duration,
|
||
elevation_gain: elevation_gain,
|
||
elevation_loss: elevation_loss,
|
||
elevation_max: elevation_max,
|
||
elevation_min: elevation_min,
|
||
original_path: linestring_wkt
|
||
)
|
||
|
||
# Associate points with the track
|
||
track_points.each { |p| p.update_column(:track_id, track.id) }
|
||
|
||
created_count += 1
|
||
print '.' if (index + 1) % 5 == 0
|
||
end
|
||
|
||
puts '' if created_count > 0
|
||
created_count
|
||
end
|
||
|
||
def haversine_distance(lat1, lon1, lat2, lon2)
|
||
# Haversine formula to calculate distance in meters
|
||
rad_per_deg = Math::PI / 180
|
||
rm = 6371000 # Earth radius in meters
|
||
|
||
dlat_rad = (lat2 - lat1) * rad_per_deg
|
||
dlon_rad = (lon2 - lon1) * rad_per_deg
|
||
|
||
lat1_rad = lat1 * rad_per_deg
|
||
lat2_rad = lat2 * rad_per_deg
|
||
|
||
a = Math.sin(dlat_rad / 2)**2 + Math.cos(lat1_rad) * Math.cos(lat2_rad) * Math.sin(dlon_rad / 2)**2
|
||
c = 2 * Math.atan2(Math.sqrt(a), Math.sqrt(1 - a))
|
||
|
||
rm * c # Distance in meters
|
||
end
|
||
end
|