Skip to content
/ 1brc Public
forked from gunnarmorling/1brc

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

www.morling.dev/blog/one-billion-row-challenge/

License

Apache-2.0 license
0 stars 1.9k forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

charlielye/1brc

BranchesTags
 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

473 Commits
.github
.github
 
 
.mvn/wrapper
.mvn/wrapper
 
 
data
data
 
 
etc
etc
 
 
src
src
 
 
.gitattributes
.gitattributes
 
 
.gitignore
.gitignore
 
 
1brc.png
1brc.png
 
 
LICENSE.txt
LICENSE.txt
 
 
README.md
README.md
 
 
calculate_average_AbstractKamen.sh
calculate_average_AbstractKamen.sh
 
 
calculate_average_C5H12O5.sh
calculate_average_C5H12O5.sh
 
 
calculate_average_JamalMulla.sh
calculate_average_JamalMulla.sh
 
 
calculate_average_JesseVanRooy.sh
calculate_average_JesseVanRooy.sh
 
 
calculate_average_Kidlike.sh
calculate_average_Kidlike.sh
 
 
calculate_average_MahmoudFawzyKhalil.sh
calculate_average_MahmoudFawzyKhalil.sh
 
 
calculate_average_MeanderingProgrammer.sh
calculate_average_MeanderingProgrammer.sh
 
 
calculate_average_SamuelYvon.sh
calculate_average_SamuelYvon.sh
 
 
calculate_average_Ujjwalbharti.sh
calculate_average_Ujjwalbharti.sh
 
 
calculate_average_abeobk.sh
calculate_average_abeobk.sh
 
 
calculate_average_abfrmblr.sh
calculate_average_abfrmblr.sh
 
 
calculate_average_adriacabeza.sh
calculate_average_adriacabeza.sh
 
 
calculate_average_ags313.sh
calculate_average_ags313.sh
 
 
calculate_average_alesj.sh
calculate_average_alesj.sh
 
 
calculate_average_algirdasrascius.sh
calculate_average_algirdasrascius.sh
 
 
calculate_average_anandmattikopp.sh
calculate_average_anandmattikopp.sh
 
 
calculate_average_anitasv.sh
calculate_average_anitasv.sh
 
 
calculate_average_arjenvaneerde.sh
calculate_average_arjenvaneerde.sh
 
 
calculate_average_arjenw.sh
calculate_average_arjenw.sh
 
 
calculate_average_armandino.sh
calculate_average_armandino.sh
 
 
calculate_average_artpar.sh
calculate_average_artpar.sh
 
 
calculate_average_artsiomkorzun.sh
calculate_average_artsiomkorzun.sh
 
 
calculate_average_as-com.sh
calculate_average_as-com.sh
 
 
calculate_average_baseline.sh
calculate_average_baseline.sh
 
 
calculate_average_baseline_original_rounding.sh
calculate_average_baseline_original_rounding.sh
 
 
calculate_average_berry120.sh
calculate_average_berry120.sh
 
 
calculate_average_bjhara.sh
calculate_average_bjhara.sh
 
 
calculate_average_charlibot.sh
calculate_average_charlibot.sh
 
 
calculate_average_cliffclick.sh
calculate_average_cliffclick.sh
 
 
calculate_average_coolmineman.sh
calculate_average_coolmineman.sh
 
 
calculate_average_couragelee.sh
calculate_average_couragelee.sh
 
 
calculate_average_criccomini.sh
calculate_average_criccomini.sh
 
 
calculate_average_davecom.sh
calculate_average_davecom.sh
 
 
calculate_average_davery22.sh
calculate_average_davery22.sh
 
 
calculate_average_ddimtirov.sh
calculate_average_ddimtirov.sh
 
 
calculate_average_deemkeen.sh
calculate_average_deemkeen.sh
 
 
calculate_average_dmitry-midokura.sh
calculate_average_dmitry-midokura.sh
 
 
calculate_average_ebarlas.sh
calculate_average_ebarlas.sh
 
 
calculate_average_entangled90.sh
calculate_average_entangled90.sh
 
 
calculate_average_eriklumme.sh
calculate_average_eriklumme.sh
 
 
calculate_average_faridtmammadov.sh
calculate_average_faridtmammadov.sh
 
 
calculate_average_fatroom.sh
calculate_average_fatroom.sh
 
 
calculate_average_felix19350.sh
calculate_average_felix19350.sh
 
 
calculate_average_filiphr.sh
calculate_average_filiphr.sh
 
 
calculate_average_flippingbits.sh
calculate_average_flippingbits.sh
 
 
calculate_average_fragmede.sh
calculate_average_fragmede.sh
 
 
calculate_average_gabrielreid.sh
calculate_average_gabrielreid.sh
 
 
calculate_average_gamlerhart.sh
calculate_average_gamlerhart.sh
 
 
calculate_average_gnabyl.sh
calculate_average_gnabyl.sh
 
 
calculate_average_gnmathur.sh
calculate_average_gnmathur.sh
 
 
calculate_average_gonix.sh
calculate_average_gonix.sh
 
 
calculate_average_hallvard.sh
calculate_average_hallvard.sh
 
 
calculate_average_hchiorean.sh
calculate_average_hchiorean.sh
 
 
calculate_average_hundredwatt.sh
calculate_average_hundredwatt.sh
 
 
calculate_average_ianopolous.sh
calculate_average_ianopolous.sh
 
 
calculate_average_ianopolousfast.sh
calculate_average_ianopolousfast.sh
 
 
calculate_average_imrafaelmerino.sh
calculate_average_imrafaelmerino.sh
 
 
calculate_average_isolgpus.sh
calculate_average_isolgpus.sh
 
 
calculate_average_itaske.sh
calculate_average_itaske.sh
 
 
calculate_average_ivanklaric.sh
calculate_average_ivanklaric.sh
 
 
calculate_average_iziamos.sh
calculate_average_iziamos.sh
 
 
calculate_average_japplis.sh
calculate_average_japplis.sh
 
 
calculate_average_jatingala.sh
calculate_average_jatingala.sh
 
 
calculate_average_javamak.sh
calculate_average_javamak.sh
 
 
calculate_average_jbachorik.sh
calculate_average_jbachorik.sh
 
 
calculate_average_jerrinot.sh
calculate_average_jerrinot.sh
 
 
calculate_average_jgrateron.sh
calculate_average_jgrateron.sh
 
 
calculate_average_jincongho.sh
calculate_average_jincongho.sh
 
 
calculate_average_jotschi.sh
calculate_average_jotschi.sh
 
 
calculate_average_jparera.sh
calculate_average_jparera.sh
 
 
calculate_average_karthikeyan97.sh
calculate_average_karthikeyan97.sh
 
 
calculate_average_kevinmcmurtrie.sh
calculate_average_kevinmcmurtrie.sh
 
 
calculate_average_kgeri.sh
calculate_average_kgeri.sh
 
 
calculate_average_khmarbaise.sh
calculate_average_khmarbaise.sh
 
 
calculate_average_kuduwa-keshavram.sh
calculate_average_kuduwa-keshavram.sh
 
 
calculate_average_kumarsaurav123.sh
calculate_average_kumarsaurav123.sh
 
 
calculate_average_lawrey.sh
calculate_average_lawrey.sh
 
 
calculate_average_maeda6uiui.sh
calculate_average_maeda6uiui.sh
 
 
calculate_average_maximz101.sh
calculate_average_maximz101.sh
 
 
calculate_average_merykitty.sh
calculate_average_merykitty.sh
 
 
calculate_average_merykittyunsafe.sh
calculate_average_merykittyunsafe.sh
 
 
calculate_average_moysesb.sh
calculate_average_moysesb.sh
 
 
calculate_average_mtopolnik.sh
calculate_average_mtopolnik.sh
 
 
calculate_average_mudit-saxena.sh
calculate_average_mudit-saxena.sh
 
 
calculate_average_netrunnereve.sh
calculate_average_netrunnereve.sh
 
 
calculate_average_obourgain.sh
calculate_average_obourgain.sh
 
 
calculate_average_omarchenko4j.sh
calculate_average_omarchenko4j.sh
 
 
calculate_average_padreati.sh
calculate_average_padreati.sh
 
 
calculate_average_palmr.sh
calculate_average_palmr.sh
 
 
calculate_average_parkertimmins.sh
calculate_average_parkertimmins.sh
 
 

Repository files navigation

1️⃣🐝🏎️ The One Billion Row Challenge

A C++ implementation of the orignal java challenge here: https://github.com/gunnarmorling/1brc

Discussion thread here: gunnarmorling#495

Example usage.

clang++-16 -O3 -std=c++20 -march=native -pthread main.cpp
THREADS=8 ./a.out

g++ should also work. You can also specify the number of "linear chunks" with CHUNKS env var. Unmaps will occur at end of each chunk. Default is 8.

CHUNKS=8 THREADS=8 ./a.out

About

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

www.morling.dev/blog/one-billion-row-challenge/

Resources

Readme

License

Apache-2.0 license
Activity

Stars

0 stars

Watchers

0 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages

  • Java 88.8%
  • Shell 9.6%
  • C++ 1.3%
  • Python 0.3%