Dawarich not working after upgrade to 0.25.0

[marsmathis]

OS & Hardware
Proxmox, Intel i7 10th Generation

Version
0.25.0

Describe the bug
I upgraded to 0.25.0 using docker compose pull and docker compose up -d. I then went to the login page which worked but upon logging in and being redirected to [url]/map I got the error seen in the screenshot below.

Expected behavior
See the Dawarich UI

Screenshots

[Freika]

@marsmathis did you follow the instructions in the release notes?

[marsmathis]

I just did, but I still get the same error. Maybe I did it wrong?

[thebankjob]

i have the same error. I make also the data migration

[tbuchloh]

I got the same error on map page.

The console script returned with

ActiveRecord::AssociationNotFoundError: Association named 'places' was not found on Visit; perhaps you misspelled it?
from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/associations.rb:56:in 'ActiveRecord::Associations#association'

[t0mcat1337]

For me too... I followed the steps in the Release Notes, which worked:

and resolved the issue... Then dawarich works for a few minutes but after some time it stops, just gives HTTP 500 Codes for each request to /map
This is in containers out:

I, [2025-03-16T16:55:35.141198 #62]  INFO -- : {"method":"GET","path":"/map","format":"html","controller":"MapController","action":"index","status":500,"allocations":1993,"duration":125.17,"view":0.0,"db":5.54}
E, [2025-03-16T16:55:35.161047 #62] ERROR -- :   
NoMethodError (undefined method 'y' for nil):
  
app/controllers/map_controller.rb:11:in 'block in MapController#index'
app/controllers/map_controller.rb:11:in 'Array#map'
app/controllers/map_controller.rb:11:in 'MapController#index'
E, [2025-03-16T16:55:35.366050 #62] ERROR -- :   
ActionController::RoutingError (No route matches [GET] "/favicon.ico"):

I restarted the container wihtout success... I even did the command from the release notes again which gave a bunch of errors... now the container remains in this non-working state...

I noticed, the /stats page is still working, /map does not

[Freika]

I got the same error on map page.

The console script returned with

ActiveRecord::AssociationNotFoundError: Association named 'places' was not found on Visit; perhaps you misspelled it?
from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/associations.rb:56:in 'ActiveRecord::Associations#association'

It seems like you have a type somewhere, because it should not return this specific error

[t0mcat1337]

Just rolled back to 0.24.1, this version works without any issues.

[Freika]

For me too... I followed the steps in the Release Notes, which worked:

and resolved the issue... Then dawarich works for a few minutes but after some time it stops, just gives HTTP 500 Codes for each request. This is in containers out:

I, [2025-03-16T16:55:35.141198 #62]  INFO -- : {"method":"GET","path":"/map","format":"html","controller":"MapController","action":"index","status":500,"allocations":1993,"duration":125.17,"view":0.0,"db":5.54}
E, [2025-03-16T16:55:35.161047 #62] ERROR -- :   
NoMethodError (undefined method 'y' for nil):
  
app/controllers/map_controller.rb:11:in 'block in MapController#index'
app/controllers/map_controller.rb:11:in 'Array#map'
app/controllers/map_controller.rb:11:in 'MapController#index'
E, [2025-03-16T16:55:35.366050 #62] ERROR -- :   
ActionController::RoutingError (No route matches [GET] "/favicon.ico"):

I restarted the container wihtout success... I even did the command from the release notes again which gave a bunch of errors... now the container remains in this non-working state...

I noticed, the /stats page is still working, /map does not

Try running user.tracked_points.where.not(lonlat: nil).size) in the console to get the number of not converted points. If it's non-zero, try running this again:

user = User.find_by(email: 'your@email')

user.tracked_points.update_all('lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)')

[t0mcat1337]

user.tracked_points.where.not(lonlat: nil).size)

What exactly do I have to do for "The user variable must be set as shown in the changelog instruction"? I never programmed in ruby / rails... just have experiences in PHP and Python...

[Freika]

@t0mcat1337 full script:

user = User.find_by(email: 'your@email')

user.tracked_points.update_all('lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)')

[tbuchloh]

Try running user.tracked_points.where.not(lonlat: nil).size) in the console to get the number of not converted points. If it's non-zero, try running this again:

user.tracked_points.update_all('lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)')

I did it on database level:

dawarich_prod=# select count(*) from points where lonlat is null;
 count  
--------
 292351
(1 row)

That's the number of my currently tracked points.

Then I executed on database:

update points
set lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)::geography
where lonlat is null;

I got the error message ERROR: posting list tuple with 2 items cannot be split at offset 2 from Postgis.

This sequence solved my issue:

REINDEX DATABASE dawarich_prod;

update points
set lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)::geography
where lonlat is null;

[t0mcat1337]

@t0mcat1337 full script:

user = User.find_by(email: 'your@email')

user.tracked_points.update_all('lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)')

Thx, but this didn't work:

dawarich(prod)> user = User.find_by(email: 'mail@domain.de')
=> 
#<User id: 1, email: "mail@domain.de", created_at: "2025-02-05 11:18:55.864322000 +0100", updated_at: "2025-03-16 17:46:04.794221000 +0100", api_key: [FILTERED], theme: "dark", settings: {"fog_of_war_meters" => "100", "meters_between_routes" => "1000"...
dawarich(prod)> user.tracked_points.where.not(lonlat: nil).size
=> 6270
dawarich(prod)> user.tracked_points.update_all('lonlat = ST_SetSRID(ST_MakePoint(longitude, latitude), 4326)')
(dawarich):20:in '<main>': PG::UniqueViolation: ERROR:  duplicate key value violates unique constraint "index_points_on_lonlat_timestamp_user_id" (ActiveRecord::RecordNotUnique)
DETAIL:  Key (lonlat, "timestamp", user_id)=(0101000020E610000008E9297288781C40A54C6A6803684940, 1742144272, 1) already exists.

/var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/postgresql/database_statements.rb:162:in 'PG::Connection#exec_params': ERROR:  duplicate key value violates unique constraint "index_points_on_lonlat_timestamp_user_id" (PG::UniqueViolation)
DETAIL:  Key (lonlat, "timestamp", user_id)=(0101000020E610000008E9297288781C40A54C6A6803684940, 1742144272, 1) already exists.

        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/postgresql/database_statements.rb:162:in 'ActiveRecord::ConnectionAdapters::PostgreSQL::DatabaseStatements#perform_query'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:556:in 'block (2 levels) in ActiveRecord::ConnectionAdapters::DatabaseStatements#raw_execute'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract_adapter.rb:1011:in 'block in ActiveRecord::ConnectionAdapters::AbstractAdapter#with_raw_connection'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activesupport-8.0.1/lib/active_support/concurrency/null_lock.rb:9:in 'ActiveSupport::Concurrency::NullLock#synchronize'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract_adapter.rb:983:in 'ActiveRecord::ConnectionAdapters::AbstractAdapter#with_raw_connection'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:555:in 'block in ActiveRecord::ConnectionAdapters::DatabaseStatements#raw_execute'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activesupport-8.0.1/lib/active_support/notifications/instrumenter.rb:58:in 'ActiveSupport::Notifications::Instrumenter#instrument'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract_adapter.rb:1129:in 'ActiveRecord::ConnectionAdapters::AbstractAdapter#log'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:554:in 'ActiveRecord::ConnectionAdapters::DatabaseStatements#raw_execute'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:591:in 'ActiveRecord::ConnectionAdapters::DatabaseStatements#internal_execute'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:173:in 'ActiveRecord::ConnectionAdapters::DatabaseStatements#exec_update'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/database_statements.rb:208:in 'ActiveRecord::ConnectionAdapters::DatabaseStatements#update'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/query_cache.rb:27:in 'ActiveRecord::ConnectionAdapters::AbstractAdapter#update'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/relation.rb:617:in 'block in ActiveRecord::Relation#update_all'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_adapters/abstract/connection_pool.rb:418:in 'ActiveRecord::ConnectionAdapters::ConnectionPool#with_connection'
        from /var/app/vendor/bundle/ruby/3.4.0/gems/activerecord-8.0.1/lib/active_record/connection_handling.rb:310:in 'ActiveRecord::ConnectionHandling#with_connection'
        ... 33 levels...

[Freika]

@t0mcat1337 have a look here about this new error: #948 (reply in thread)

[t0mcat1337]

@t0mcat1337 have a look here about this new error: #948 (reply in thread)

Adapted the mentioned steps for my duplicate (which fortunately was just 1 single one), did user.tracked_points.update_all... again and this time it worked, /map is also working again.

Perhaps it would be worth thinking about some sort of database check/repair steps during updates (nextcloud for example has implemented such for a longer while)... especially for non-IT experienced users...

[t0mcat1337]

And again, /map stops working... could it be triggered each time when new points arrive from external devices? (in my case a single Android Smartphone with OwnTracks connected to dawarich)...