Skip to content

Release v0.6.0

Compare
Choose a tag to compare
@StanChe StanChe released this 19 Mar 16:33
· 38 commits to develop since this release
5f0799e

Changelog

All notable changes to this project will be documented in this file.

0.6.0 - 2025-03-19

Bug Fixes

  • Drop core indexing from make file (ddd1467)

  • Add required permissions for GitHub Container Registry (#410) (d3e4623)

  • [MTG-1301] Fix Docker workflow to use GitHub Container Registry (#412) (f22ab9f)

  • Fix the build arg in docker (#417) (faef18d)

  • Encase version info build arg in quotes (#418) (c9924d9)

  • Reorder cursor and options params in api requests (#411) (cf54be2)

  • MTG-1225 stop setting asset owner for Fungible tokens in assets_v3 table (ecbce76)

  • Parse big table config into the correct type (#430) (946d4e4)

  • Resolve issues with release workflows (#432) (f49ee30)

  • Change parse_json expected type in config (#435) (411ea91)

  • Fix github PR creation in release prepare [MTG-1360] (#439) (1cbe9f7)

  • Make backfill not wait for CTRL-C (#445) (370d3d3)

  • Prioritize slot ordering over version in comparison logic [MTG-1415] (#446) (98b517f)

  • Reorder SearchAssets fields to comply with V0 repr (#451) (55f3050)

  • Fix cursor pagination for fungibles and nonfungibles (#457) (5e2307c)

Build Process & Auxiliary Tools

  • Make build happy (2a18411)

  • Bump rust toolchain version to 1.84 (55aa90a)

  • Return back old env example because we have example_new (a96eec8)

  • Configure a single sensible rustfmt, format (9b58797)

  • Remove unused enum definitions (a72dfb1)

  • Remove PrintableNft definition & usages (4fb61d7)

  • Fmt (8868956)

  • Regenerate rust files (59db74e)

  • Add consistency check to ingester.Dockerfile (70e7466)

  • Remove panic from account processor job start (841529b)

  • Add start-rocksdb-backup command to Makefile (74e4c48)

  • Mount primary rocksdb path as readonly to backup container (084b2a9)

  • Optimize retrieval of assets (f56abf4)

  • Move raydium api url to consts.rs (d8beac4)

  • Move out pprof as optional, gate behind feature (75a058a)

  • Fmt rust workflow (464967c)

  • Reorder contributing readme section (0200e69)

  • Fix ignored tests (#414) (c730dac)

  • Clean up env some more & downsize compose (#425) (a2472a9)

  • [MTG-1360] release process (#431) (b0cbe40)

  • Modularize release preparation process [MTG-1360] (#436) (6b1cb34)

  • Bump rust toolchain to 1.85 (#438) (bf1b557)

  • Merge release v0.5 (#442) (4ae77f2)

  • Bump version to 0.6.0 (b18a983)

CI/CD

Documentation

  • Add GitFlow contribution guidelines (#402) (7d044bc)

  • [MTG-1221] Add comprehensive architecture documentation (#420) (d68d0ac)

  • Fixed broken link and grammatical errors (ea24003)

Features

  • Update rust versions in dockerfiles & rust-toolchain.toml (38f2d98)

  • Add env feature for clap (f52806f)

  • Drop profiling for slot persister (5092470)

  • Change the way workers take envs (0725a9a)

  • Change env slightly for secondary DB (73debce)

  • Drop profiling from docker compose for slot persister (728af36)

  • Revert changes (2d8f4d0)

  • Update env.example (5fb21b8)

  • Add a separate secondary rocks backup service (1fbfc10)

  • Make the backup service a one-time job (4d01d0c)

  • Use PathBufs in backup-related functions (221938b)

  • Add metrics for RedisReceiver (72a9ad0)

  • Extend range of interfaces for supply object display (#382) (f2a45d7)

  • Add Raydium price fetcher cache warmup for symbols (39c0457)

  • Add exclusive backoff for signature fetch (68f14ba)

  • Cover json downloader with tests (e91de01)

  • Reverse backfill from the newest slots to the oldest (#407) (9bda337)

  • Rework Dockerfiles and improve build (2324b6c)

  • Add docker build workflow (4a66616)

  • Add version info to images (9fd5ace)

  • Add repository dispatch to docker job (5353d58)

  • Update blockbuster, bubblegum-batch-sdk to fix acct decode panic (#419) (b01a695)

  • Rework payload parsing (#423) (e18e809)

  • Improve env variables (fcfadc3)

  • Rework data formats used in bubblegum transaction processing (#422) (62b6d94)

  • Overhaul task spawning in the whole project (#433) (427cc6d)

  • Improve the deployment process (#437) (fee9538)

  • Read snapshot from a backfill stream (#448) (b81b651)

  • Improve cancellation of signature fetching (#450) (840e5fd)

Testing

  • Add new getAsset test for regular nft collection (#377) (daac082)

  • MTG-1225 test searchAssets by owner with ShowZeroBalance: false (c69a647)

  • MTG-1225 All different search query scenarios for the showZeroBalance option are covered for all token types (ba768bd)

0.5.0 - 2025-03-04

Bug Fixes

  • Drop core indexing from make file (ddd1467)

  • Add required permissions for GitHub Container Registry (#410) (d3e4623)

  • [MTG-1301] Fix Docker workflow to use GitHub Container Registry (#412) (f22ab9f)

  • Fix the build arg in docker (#417) (faef18d)

  • Encase version info build arg in quotes (#418) (c9924d9)

  • Reorder cursor and options params in api requests (#411) (cf54be2)

  • MTG-1225 stop setting asset owner for Fungible tokens in assets_v3 table (ecbce76)

Build Process & Auxiliary Tools

  • Make build happy (2a18411)

  • Bump rust toolchain version to 1.84 (55aa90a)

  • Return back old env example because we have example_new (a96eec8)

  • Configure a single sensible rustfmt, format (9b58797)

  • Remove unused enum definitions (a72dfb1)

  • Remove PrintableNft definition & usages (4fb61d7)

  • Fmt (8868956)

  • Regenerate rust files (59db74e)

  • Add consistency check to ingester.Dockerfile (70e7466)

  • Remove panic from account processor job start (841529b)

  • Add start-rocksdb-backup command to Makefile (74e4c48)

  • Mount primary rocksdb path as readonly to backup container (084b2a9)

  • Optimize retrieval of assets (f56abf4)

  • Move raydium api url to consts.rs (d8beac4)

  • Move out pprof as optional, gate behind feature (75a058a)

  • Fmt rust workflow (464967c)

  • Reorder contributing readme section (0200e69)

  • Fix ignored tests (#414) (c730dac)

  • Added missing cliff config for 0.5 release (6a67ac1)

  • Dropped the version of nft_ingester to the one before 0.5 (d266f50)

  • Bump rust toolchain to 1.85 (#438) (9d705e2)

  • Cherry pick scripts for release (90c7f51)

  • Clean cliff.toml (733aaa7)

  • Bump version to 0.5.0 (09c737f)

CI/CD

Documentation

  • Add GitFlow contribution guidelines (#402) (7d044bc)

  • [MTG-1221] Add comprehensive architecture documentation (#420) (d68d0ac)

Features

  • Update rust versions in dockerfiles & rust-toolchain.toml (38f2d98)

  • Add env feature for clap (f52806f)

  • Drop profiling for slot persister (5092470)

  • Change the way workers take envs (0725a9a)

  • Change env slightly for secondary DB (73debce)

  • Drop profiling from docker compose for slot persister (728af36)

  • Revert changes (2d8f4d0)

  • Update env.example (5fb21b8)

  • Add a separate secondary rocks backup service (1fbfc10)

  • Make the backup service a one-time job (4d01d0c)

  • Use PathBufs in backup-related functions (221938b)

  • Add metrics for RedisReceiver (72a9ad0)

  • Extend range of interfaces for supply object display (#382) (f2a45d7)

  • Add Raydium price fetcher cache warmup for symbols (39c0457)

  • Add exclusive backoff for signature fetch (68f14ba)

  • Cover json downloader with tests (e91de01)

  • Reverse backfill from the newest slots to the oldest (#407) (9bda337)

  • Rework Dockerfiles and improve build (2324b6c)

  • Add docker build workflow (4a66616)

  • Add version info to images (9fd5ace)

  • Add repository dispatch to docker job (5353d58)

  • Update blockbuster, bubblegum-batch-sdk to fix acct decode panic (#419) (b01a695)

  • Rework payload parsing (#423) (e18e809)

  • Improve env variables (fcfadc3)

Testing

  • Add new getAsset test for regular nft collection (#377) (daac082)

  • MTG-1225 test searchAssets by owner with ShowZeroBalance: false (c69a647)

  • MTG-1225 All different search query scenarios for the showZeroBalance option are covered for all token types (ba768bd)

[Unreleased]

Added

  • Unique consumer ID for each worker. [MTG-1155]
  • Unique worker name to simplify debugging. [MTG-1155]
  • Ability to configure workers batch size via env variables. (account_processor_buffer_size tx_processor_buffer_size) [MTG-1155]
  • Configurable timeout for the PG database queries MTG-1110

Changed

  • Default number of Redis message reads retries to the (number of workers + 1) [MTG-1155]

Removed

Fixed

  • Issue where messages from Redis were being processed more than once, causing synchronization issues between workers. [MTG-1155]

Recommendations

  • [MTG-1155] The following settings will need to be selected in a real environment with a real load, since it is impossible to do this locally. Before this changes buffer_size used for all workers as a default value 10.
    • account_processor_buffer_size
    • tx_processor_buffer_size
    • redis_accounts_parsing_workers
    • redis_transactions_parsing_workers
  • [MTG-1110] Configur PG max query statement timeout or test default configuration.
    • INGESTER_PG_MAX_QUERY_TIMEOUT_SECS (default: 120sec)
    • SYNCHRONIZER_PG_MAX_QUERY_TIMEOUT_SECS (default: 24h)
    • MIGRATOR_PG_MAX_QUERY_TIMEOUT_SECS (default: 24h)
    • API_PG_MAX_QUERY_TIMEOUT_SECS (default: 120sec)