v1.90.0 #5532
Replies: 16 comments 42 replies
-
|
Hi! Thanks for this awesome project. I installed Immich on my server yesterday and am now importing my library. I am using an external container for Postgres using the regular Postgres image. The vectors extension doesn't seem to be available. Any workaround? This Postgres instance is shared by several apps so it may be a problem to replace the Docker image. |
Beta Was this translation helpful? Give feedback.
-
|
For anyone who uses Zalando-Postgres-Operator and is still stuck on an old version (which will break with apps of version 1.94.0 if I understood it correctly), I have finally made the jump. Not as painful as I expected, but still requires a lot more work that before now: https://git.shivering-isles.com/shivering-isles/infrastructure-gitops/-/compare/176fa49766644f921660e7d553dc04c5ee08944e...c7e6b1c7b719ac3cadd3853b0cfd378edd9676aa?from_project_id=233&straight=false |
Beta Was this translation helpful? Give feedback.
-
|
@SISheogorath I'm stuck in this situation as well and was not looking forward to it. Hopefully it won't be as painful now with your guide. Cheers! |
Beta Was this translation helpful? Give feedback.
-
|
Mhm, while immich runs now, face detection (and potentially more stuff) will be broken regularly. From my understanding zalando-postgres-operator uses WAL replication for building its cluster. Sadly pgvecto.rs doesn't support that and dies in the background. As a result once there was a failover to an existing replica after any insert into a table using vectors, new inserts will fail due to the crashed pgvector process in the background. At least that's my current thesis for the inconsistent behaviour regarding when inserts work and when they break. (They work when starting a fresh instance as primary and break after a while. When they break, the postgres logs complain about missing archive files, which lines up with the issues on the pgvecto.rs repository.) I have no idea if and how that impacts the consistency of the database. |
Beta Was this translation helpful? Give feedback.
-
|
I finally took some time to tackle this issue and went a slightly different route. With v1.95.0 introducing support for the More details here |
Beta Was this translation helpful? Give feedback.
-
|
Nice, this is pretty much the exact reason we added pgvector support. Some users got stuck on an older version because pgvecto.rs doesn't work for their setup for one reason or another. |
Beta Was this translation helpful? Give feedback.
-
|
Fantastic Update! Thank you so much! |
Beta Was this translation helpful? Give feedback.
-
|
Hi, just updated and immich stopped working. I am getting tons of this same error Edit: nevermind, a down and up again fixed this |
Beta Was this translation helpful? Give feedback.
-
|
Love your work, keep it up. 👍 |
Beta Was this translation helpful? Give feedback.
-
|
Bugs found in 1.90.x mobile so far:
|
Beta Was this translation helpful? Give feedback.
-
|
There has to be selected Recent folder for backup to show local assets on the timeline, even when backup is intentionally disabled. That's different to previous versions, where Recent were preselected by default. |
Beta Was this translation helpful? Give feedback.
-
|
If I'm using the default compose I don't need to consider this right? What about how to backup this database? can I do the backup as a normal postgress database? I'm using this? |
Beta Was this translation helpful? Give feedback.
-
|
Yup, all good. |
Beta Was this translation helpful? Give feedback.
-
|
Just started a fresh install of 1.90.1 and removed everything related to typesense. Yet I get this: |
Beta Was this translation helpful? Give feedback.
-
|
As mentioned in the notes, these changes apply from the next release. |
Beta Was this translation helpful? Give feedback.
-
|
Both announcements |
Beta Was this translation helpful? Give feedback.
-
|
Same here, I reverted those changes, and now it works; I guess the changes are for v1.91 or something. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for replying. Could the devs please update the announcement to make it clear? I made my changes and now anxiously waiting for the next release. Whatever next release actually means. Like you said maybe 1.91 will be the next release. |
Beta Was this translation helpful? Give feedback.
-
|
In Immich terms it means the next "major" weekly release which will be 1.91.0, which should happen next week. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the clarification. I will remember to Immich definition of major release going forward. |
Beta Was this translation helpful? Give feedback.
-
|
Yeah sorry about that, I update the release note to specify the anticipated version |
Beta Was this translation helpful? Give feedback.
-
|
I'm currently using Unix sockets to connect the Postgres database to Immich, but how would that work with the new pgvecto.rs? Can I still use Unix sockets or do I need to switch to the default TCP connection? |
Beta Was this translation helpful? Give feedback.
-
|
The new image extends the base postrgres image and pre-installs the extension. Sockets should work just fine still. |
Beta Was this translation helpful? Give feedback.
-
|
Its working great for me, mobile 1.90.0 and web 1.90.3 ! Thank you for this release! |
Beta Was this translation helpful? Give feedback.
-
|
Hi there ! |
Beta Was this translation helpful? Give feedback.
-
|
Something is not clear to me. I have hundreds of pictures of two different persons merged. This version gives the ability to select a person from a single picture and assign it to another person (existing or new one). But doing this manually for hundreds of pictures is not realistic. Am I missing something? Also for videos it's impossible to unmerge, because the same person appears twice in the info pane, and there is no rectangle around the faces in the video to identify which person to change... |
Beta Was this translation helpful? Give feedback.
-
|
@mertalev Correct me if I'm wrong but clustering will "only" improve face matching accuracy ? We'll still have this twin issue for very similar faces or edge cases, right ? If so, I don't see how you can have a bulk edit for this issue. IMO the best solution would be to have a tool to review your assets (can probably be used for other things), I think the App-Which-Must-Not-Be-Named offers something similar. |
Beta Was this translation helpful? Give feedback.
-
|
Not necessarily true. For example, if there are two distinct clusters that are next to each other, we can leverage the fact that we know these two clusters exist to differentiate between two people where the current clustering cannot. And in the worst case scenario where they overlap too much, the algorithm could separate the cases where it can't tell them apart into a separate "low confidence" bucket instead of assigning them to one or the other. |
Beta Was this translation helpful? Give feedback.
-
|
Oh, very interesting. I can't wait to see progress with clustering then 🤩 |
Beta Was this translation helpful? Give feedback.
-
|
Oh, for the "low confidence cluster" are you thinking about implementing something where app asks "Is this Person A?( |
Beta Was this translation helpful? Give feedback.
-
|
That's the idea, yeah. |
Beta Was this translation helpful? Give feedback.
-
I agree, this is a bad idea to forbid multiple faces of the same person. Not only because of collages, but also reflections in mirrors. |
Beta Was this translation helpful? Give feedback.
-
|
What about data that are stored on the typesense ? Will it be migrated to the new PG ? Won't all machine learning data will be recalculated ? |
Beta Was this translation helpful? Give feedback.
-
|
All the data has always been primarily stored in PG. Typesense was just a secondary copy. |
Beta Was this translation helpful? Give feedback.
-
|
🎉 I'm looking forward to making this update - Typesense about gave my system a heart attack today when restarting with 100k+ assets. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, very happy to see amazing progress !! Great job guys !! I'm thinking that external items have their metadata stored in the DB (the date/time is important for me), so a call to update the date from the DB directly would solve this issue. Ok, maybe it could get overwritten on metadata read (where the date from the file would overwrite what we custom-configured in the DB), but a flag in the table schema could make this work (DATE_MANUALLY_SET) and keep the manually set date for read-only items. Just a thought. |
Beta Was this translation helpful? Give feedback.
and others
-
v1.90.0
Important
Announcement (Breaking changes next release - v1.91.0)
Continuing the effort of reducing Immich's footprint, we would like to announce another planned change. Starting from the next release (not this release), we will be removing the Typesense container and changing the database image. Below are the changes that must be made in your docker-compose.yml file.
immich-server: [...] depends_on: - redis - database - - typesense restart: always immich-microservices: [...] depends_on: - redis - database - - typesense restart: always - typesense: - container_name: immich_typesense - image: typesense/typesense:0.24.1@sha256:9bcff2b829f12074426ca044b56160ca9d777a0c488303469143dd9f8259d4dd - environment: - - TYPESENSE_API_KEY=${TYPESENSE_API_KEY} - - TYPESENSE_DATA_DIR=/data - # remove this to get debug messages - - GLOG_minloglevel=1 - volumes: - - tsdata:/data - restart: always [...] database: container_name: immich_postgres - image: postgres:14-alpine@sha256:6a0e35296341e676fe6bd8d236c72afffe2dfe3d7eb9c2405c0f3fc04500cd07 + image: tensorchord/pgvecto-rs:pg14-v0.1.11 env_file: - .env environment: volumes: pgdata: model-cache: - tsdata:Note
Note: If you are running your database with a non-superuser role for Immich, you must enable the pgvecto.rs extension manually. You can do this by connecting to the
immichdatabase as a superuser and running:Search Background
It turns out that synchronizing data between Postgres and Typesense is quite complicated. It accounts for at least an additional 1000 lines of code and, while very feature-filled, has become a burden to maintain. Also, there have been some serious memory and performance issues with Typesense, especially with large photo collections. It is lightning fast, but at the expense of large indexes that must be read from disk into memory on each restart. There have been reports of this process taking up to 30 minutes!
We effectively remove an entire class of bugs and issues by removing the need to synchronize data. Furthermore, search queries can more easily be combined with the existing database schema, like libraries, partner sharing, albums, etc. After merging #3605, we hope to be able to make significant progress around the search implementation and feature set.
In short, some of the benefits of this change include the following:
Highlights
Welcome to release
v1.90.0of Immich. In this release, we introduce the first implementation of asset metadata editing, which includes date, time, and location. This release also contains many improvements and bug fixes. I hope you enjoy this release. Please read the following highlights below:Edit metadata
This release introduces the first implementation of editing assets.
Web
chrome_R8eIwyUEBR.mp4
Mobile App
Note
Metadata edits only apply to non-external/read-only assets.
You can now edit a photo or video's date, time, hours, timezone, and GPS information. The edited info is written to a companion sidecar file and saved in the exact library location as the original photo or video.
Please note that downloading an asset does not include the sidecar file or edited information yet.
Thanks, @YFrendo, and @jrasm91 for the valuable implementation of this feature. Thanks @shenlong-tanwen for a quick implementation on the mobile app for feature parity
Reassign person's faces
In this continuous enhancement, @martabal has implemented a mechanism to change facial data in a photo from one person to another. There is a bounding box around the person's face in the photo hovered on the face in the detail panel.
Re-assigning faces
2023-11-10.20-05-34.mp4
Hovering thumbnails
2023-11-13.11-42-12.mp4
Better handling of iCloud assets
This is the first attempt to improve the backup process for iCloud’s users. We also added a toggle to ignore backing up assets from iCloud; you can find the option in a new Backup Options page on the mobile app.
And as always, bugs are fixed, and many other improvements also come with this release.
Please consider supporting the project.
Support
If you find the project helpful, you can support Immich via the following channels.
It is a great way to let me know that you want me to continue developing and working on this project for years to come.
Changelogs
Mobile
Web
Server
sendFileby @jameskeane in Fix not awaitingsendFile#5515Documentations
Dependencies
New Contributors
sendFile#5515Full Changelog: v1.89.0...v1.90.0
Beta Was this translation helpful? Give feedback.
All reactions