Skip to content

Commit

Permalink
Enhance: Add NonValueTransformer Reverse Conversion with NAN_VALUE Re…
Browse files Browse the repository at this point in the history
…placement (#212)

* add replace_nan_value in NonValueTransformer reverse_convert

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
  • Loading branch information
MooooCat and pre-commit-ci[bot] committed Jul 31, 2024
1 parent 7d37e58 commit 1e2bf67
Showing 1 changed file with 17 additions and 2 deletions.
19 changes: 17 additions & 2 deletions sdgx/data_processors/transformers/nan.py
Original file line number Diff line number Diff line change
Expand Up @@ -137,9 +137,24 @@ def reverse_convert(self, processed_data: DataFrame) -> DataFrame:
Does not require any action.
"""
logger.info("Data reverse-converted by NonValueTransformer (No Action).")

return processed_data
def replace_nan_value(df):
"""
Scans all rows and columns in the DataFrame and replaces all cells with the value "NAN_VALUE", which is self.fill_na_value_default, with an empty string.
Parameters:
df (pd.DataFrame): The input DataFrame.
Returns:
pd.DataFrame: The DataFrame after replacement.
"""
# Use the replace method of DataFrame to replace "NAN_VALUE" with an empty string
df_replaced = df.replace(self.fill_na_value_default, "")
return df_replaced

logger.info("Data reverse-converted by NonValueTransformer.")

return replace_nan_value(processed_data)

pass

Expand Down

0 comments on commit 1e2bf67

Please sign in to comment.