-
Notifications
You must be signed in to change notification settings - Fork 79
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integer data type #91
Comments
With these changes, I'm getting a lot of warnings about narrowing casts. |
(Background/refresher: fundamental C++ types and fixed-width integer types) Just to add some context for this discussion, these are our main sources/issues with integers, as far as I can recall:
Ideally, we should come up with a consistent use of integers that satisfies all of these. Edit: An additional thought: while we don't want to do it for production, we could compile with |
* Add environment variable LBANN_NUM_IO_PARTITIONS Specify the number of partitions in the depth dimension of the Cosmoflow samples. * Adjust the base offset for parallel sample I/O * WIP: Further adjustment of sample sizes * WIP: sample size adjustment * WIP: sample size adjustment * Remove debug output * Cosmoflow parallel io (LBANN#86) * before rebase * updating * updating * small changes * moving around where data is read in NOT DONE YET * updated some comments and some todo * cleaning up * added comm member variabe * cleaning up * compiles, fixes stray variables and typos, adds correct member variables * changing responses to float,taking away division, removing from image_data_reader * fixing a mistake * oops, changing m_all_responses back to float * changed some variable names, changed indenting and fixed vim problems, fixed file access * fixed duplicate count * transposed dimensions, reverted resnet, took odd spacing and print statements out * removed timing * fixing comments and spacing * Missing semicolon * Fix type mismatch * Remove trailing whitespaces * HDF5 bug fixes * Size adjustment fix * Refactoring * Support strided rank ordering * Fix hang in HDF5 MPI-IO HDF5 caused hanging. Likely because a HDF5 property was created with MPI at every fetch_datum. The property is now moved out of the function and is only done once, so it should not hang anymore. Yet, MPI-IO is disabled for now. Should be looked into again once everything becomes working. * Disables assertion This assertion fails when the last mini-batch is not a full one. Not sure why it fails now and not before. * Use normalized parameters in Cosmoflow * Fix copying of a non-halo-expanded host tensor to a halo-extended device tensor. The distconv::Copy function doesn't seem to be working correctly, though more comprehensive investigation is needed. * Enable assertion check on mini-batch size again * Disable debug output * Temporary add debug dump in generic_input_layer * Delete irelevant comment * Fix response value loading when rank reordering is not used * Formatting * Fix protobuf version in superbuild * Cleanup before merging to the mainline branch * Further cleanup * Check if int16 input is enabled
As of d2c414a,
int
is the standard integer data type. However, we may need 64-bit integers for very large matrices. Variables susceptible to overflow should be changed toEl::Int
. As a rule of thumb, indices into Elemental matrices should beEl::Int
s.The text was updated successfully, but these errors were encountered: