Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

✅(api) test the Statique MV refresh consistency #363

Merged
merged 2 commits into from
Jan 29, 2025
Merged

✅(api) test the Statique MV refresh consistency #363

merged 2 commits into from
Jan 29, 2025

Conversation

jmaupetit
Copy link
Member

Purpose

We want to be sure that the Statique MV is always up-to-date.

Proposal

  • test field update
  • test new entries update

@jmaupetit
✅(api) test the Statique MV refresh consistency
6ae574a 
We want to be sure that the Statique MV is always up-to-date.
@jmaupetit jmaupetit self-assigned this Jan 29, 2025
@jmaupetit jmaupetit added bug Something isn't working needs review API Item related to the API service labels Jan 29, 2025
@github-actions GitHub Actions
Copy link

Current benchmark

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s Failures/s 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% git timestamp version
GET /auth/whoami 36 0 360.0 391.93022150000047 2.005905999993729 1048.986651000007 160.0 1.5171236141465765 0.0 370 430 720 740 890 950 1000 1000 1000 1000 1000 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /dynamique/session/ 39 0 360.0 439.1953461538421 5.382293999986132 1553.1423029999871 45.0 1.6435505819921243 0.0 360 580 660 690 950 1300 1600 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /dynamique/session/bulk 34 0 280.0 407.6221241176454 7.7499909999971806 1540.0213329999983 411.0 1.4328389689162109 0.0 320 630 660 730 1100 1300 1500 1500 1500 1500 1500 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /dynamique/status/ 34 0 410.0 527.436802558822 6.252566999989995 1558.6355349999792 268.3529411764706 1.4328389689162109 0.0 510 660 720 790 1200 1600 1600 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /dynamique/status/ 51 0 630.0 584.841711450982 3.662176999995381 1564.7324090000154 45.0 2.1492584533743164 0.0 630 700 900 950 1300 1400 1600 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /dynamique/status/FRALLEGO002006P3 26 0 370.0 519.7354739615396 5.842989000001353 1314.0709209999957 274.7692307692308 1.0957003879947496 0.0 500 860 890 900 1200 1300 1300 1300 1300 1300 1300 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /dynamique/status/FRALLEGO002006P3/history 23 0 400.0 455.7339827826061 6.573922000001176 1075.183595999988 52750.91304347826 0.9692734201492016 0.0 400 660 860 890 950 950 1100 1100 1100 1100 1100 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /dynamique/status/bulk 33 0 330.0 379.38071866666735 7.362911999990729 1080.5230839999922 411.0 1.3906966463010284 0.0 330 440 590 620 650 980 1100 1100 1100 1100 1100 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /statique/ 39 17 340.0 426.257835102565 10.622736000016175 1385.7877339999902 56.82051282051282 1.6435505819921243 0.7164194844581054 340 500 710 720 1100 1300 1400 1400 1400 1400 1400 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /statique/?limit=10 30 30 530.0 565.2915878333347 9.64420900001528 1515.9046570000214 81.0 1.2642696784554803 1.2642696784554803 610 700 780 900 1300 1400 1500 1500 1500 1500 1500 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /statique/?limit=100 32 32 590.0 583.2359970937481 7.539553999976079 1524.6658849999903 82.0 1.3485543236858455 1.3485543236858455 640 780 790 1100 1200 1300 1500 1500 1500 1500 1500 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
PUT /statique/FR073EP7QU5233 35 0 320.0 357.426055971426 22.698118999983308 1311.4645210000049 1371.0 1.4749812915313936 0.0 320 440 660 710 790 940 1300 1300 1300 1300 1300 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
GET /statique/FRALLEGO002006P3 24 24 650.0 640.3782876250001 4.535964000012882 1552.9550419999794 111.0 1.0114157427643842 1.0114157427643842 660 940 1200 1200 1300 1300 1600 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
POST /statique/bulk 40 0 720.0 794.8191001500013 289.13835500000573 1561.801566000014 1104.525 1.685692904607307 0.0 730 910 1100 1200 1300 1500 1600 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0
Aggregated 476 103 430.0 506.9111657289915 2.005905999993729 1564.7324090000154 2876.021008403361 20.059745564826954 4.340659229363816 430 660 770 870 1200 1300 1500 1600 1600 1600 1600 20dbf1b 2025-01-29 11:10:25.093661+00:00 0.16.0

Comparison with the latest previous benchmark

A lower (negative) value means the current version performs better than the previous one.

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s
GET /auth/whoami
POST /dynamique/session/
POST /dynamique/session/bulk
GET /dynamique/status/
POST /dynamique/status/
GET /dynamique/status/FRALLEGO002006P3
GET /dynamique/status/FRALLEGO002006P3/history
POST /dynamique/status/bulk
POST /statique/
GET /statique/?limit=10
GET /statique/?limit=100
PUT /statique/FR073EP7QU5233
GET /statique/FRALLEGO002006P3
POST /statique/bulk
Aggregated

@github-actions GitHub Actions
Copy link

Current benchmark

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s Failures/s 50% 66% 75% 80% 90% 95% 98% 99% 99.9% 99.99% 100% git timestamp version
GET /auth/whoami 38 0 63.0 246.77546565789345 1.8309769999973469 1014.4894590000036 160.0 1.647410342196754 0.0 64 310 530 540 700 1000 1000 1000 1000 1000 1000 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /dynamique/session/ 46 0 310.0 354.0258984782628 5.596245999981875 1387.7066519999914 45.0 1.9942335721329127 0.0 320 410 620 650 900 980 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /dynamique/session/bulk 38 0 380.0 488.6707229999992 10.729890999982672 1224.3329559999836 411.0 1.647410342196754 0.0 540 710 740 800 1000 1100 1200 1200 1200 1200 1200 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /dynamique/status/ 42 0 100.0 341.49509799999913 8.437444999998434 986.9587709999904 285.0 1.8208219571648332 0.0 160 370 700 770 880 970 990 990 990 990 990 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /dynamique/status/ 43 0 330.0 394.0765871395335 5.878752999990411 1385.171366999998 45.0 1.8641748609068527 0.0 330 560 680 800 960 970 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /dynamique/status/FRALLEGO002006P3 45 0 340.0 394.66589422222063 14.76481499997817 1255.714737999995 283.0 1.950880668390893 0.0 340 390 610 710 1100 1200 1300 1300 1300 1300 1300 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /dynamique/status/FRALLEGO002006P3/history 46 0 140.0 365.8720806956486 13.889860999995562 1408.9523269999802 66273.26086956522 1.9942335721329127 0.0 140 380 650 730 990 1200 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /dynamique/status/bulk 45 0 320.0 393.09103902222415 13.759521999986646 1388.1818880000196 411.0 1.950880668390893 0.0 320 470 700 720 960 1200 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /statique/ 51 23 380.0 464.464559176469 19.273112000007583 1409.9067070000046 58.52941176470589 2.210998090843012 0.9971167860664564 380 630 790 800 960 1200 1300 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /statique/?limit=10 28 28 370.0 549.3908445714309 33.39033000000313 1409.0738730000112 81.0 1.2138813047765555 1.2138813047765555 470 790 990 1000 1200 1200 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /statique/?limit=100 28 28 310.0 391.2573652857136 20.00325299999872 1043.5286729999973 82.0 1.2138813047765555 1.2138813047765555 350 580 620 700 910 970 1000 1000 1000 1000 1000 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
PUT /statique/FR073EP7QU5233 32 0 300.0 357.43507578125025 25.87117399997396 958.9092140000162 1371.0 1.3872929197446349 0.0 320 510 690 710 810 940 960 960 960 960 960 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
GET /statique/FRALLEGO002006P3 32 32 340.0 434.4020409687479 5.896355000004405 1376.8401819999951 111.0 1.3872929197446349 1.3872929197446349 350 700 790 810 1000 1200 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
POST /statique/bulk 38 0 850.0 741.3027378947387 248.86628300001237 1388.0305039999996 1101.3157894736842 1.647410342196754 0.0 850 940 970 1000 1200 1200 1400 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0
Aggregated 552 111 340.0 419.0825103985501 1.8309769999973469 1409.9067070000046 5823.0 23.930802865594952 4.812172315364203 340 580 720 800 970 1100 1200 1400 1400 1400 1400 4b175ec 2025-01-29 11:27:50.411520+00:00 0.16.0

Comparison with the latest previous benchmark

A lower (negative) value means the current version performs better than the previous one.

Type Name Request Count Failure Count Median Response Time Average Response Time Min Response Time Max Response Time Average Content Size Requests/s
GET /auth/whoami
POST /dynamique/session/
POST /dynamique/session/bulk
GET /dynamique/status/
POST /dynamique/status/
GET /dynamique/status/FRALLEGO002006P3
GET /dynamique/status/FRALLEGO002006P3/history
POST /dynamique/status/bulk
POST /statique/
GET /statique/?limit=10
GET /statique/?limit=100
PUT /statique/FR073EP7QU5233
GET /statique/FRALLEGO002006P3
POST /statique/bulk
Aggregated

@jmaupetit jmaupetit merged commit c18a0c0 into main Jan 29, 2025
14 of 15 checks passed
@jmaupetit jmaupetit deleted the api-test-refresh-mv branch January 29, 2025 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@loco-philippe loco-philippe loco-philippe approved these changes

Assignees

@jmaupetit jmaupetit

Labels
API Item related to the API service bug Something isn't working needs review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jmaupetit @loco-philippe