issue in cell 776, missing group by of feature columns

[balalavanya]

    grouped_columns = df.loc[partition].agg(aggregations, squeeze=False)

[balalavanya]

not working for categorical column, error "unhashable type: 'list'"
i tried with features
feature_columns = ['age', 'occupation']

[pablomoha]

Hey Nithin, when i run this command:

dfn = build_anonymized_dataset(df, finished_partitions, feature_columns, sensitive_column)

it shows me this error.
can you help me please.
Thank you.

TypeError Traceback (most recent call last)
D:\anaconda\lib\site-packages\pandas\core\series.py in aggregate(self, func, axis, *args, **kwargs)
3960 try:
-> 3961 result = self.apply(func, *args, **kwargs)
3962 except (ValueError, AttributeError, TypeError):

D:\anaconda\lib\site-packages\pandas\core\series.py in apply(self, func, convert_dtype, args, **kwds)
4107 values = self.astype(object)._values
-> 4108 mapped = lib.map_infer(values, f, convert=convert_dtype)
4109

pandas_libs\lib.pyx in pandas._libs.lib.map_infer()

in agg_categorical_column(series)
1 def agg_categorical_column(series):
----> 2 return [','.join(set(series))]
3

TypeError: 'int' object is not iterable

During handling of the above exception, another exception occurred:

TypeError Traceback (most recent call last)
D:\anaconda\lib\site-packages\pandas\core\frame.py in aggregate(self, func, axis, *args, **kwargs)
7574 try:
-> 7575 result, how = self._aggregate(func, axis, *args, **kwargs)
7576 except TypeError as err:

D:\anaconda\lib\site-packages\pandas\core\frame.py in _aggregate(self, arg, axis, *args, **kwargs)
7605 return result, how
-> 7606 return aggregate(self, arg, *args, **kwargs)
7607

D:\anaconda\lib\site-packages\pandas\core\aggregation.py in aggregate(obj, arg, *args, **kwargs)
565 arg = cast(AggFuncTypeDict, arg)
--> 566 return agg_dict_like(obj, arg, _axis), True
567 elif is_list_like(arg):

D:\anaconda\lib\site-packages\pandas\core\aggregation.py in agg_dict_like(obj, arg, _axis)
751 # key used for column selection and output
--> 752 results = {key: obj._gotitem(key, ndim=1).agg(how) for key, how in arg.items()}
753

D:\anaconda\lib\site-packages\pandas\core\aggregation.py in (.0)
751 # key used for column selection and output
--> 752 results = {key: obj._gotitem(key, ndim=1).agg(how) for key, how in arg.items()}
753

D:\anaconda\lib\site-packages\pandas\core\series.py in aggregate(self, func, axis, *args, **kwargs)
3962 except (ValueError, AttributeError, TypeError):
-> 3963 result = func(self, *args, **kwargs)
3964

in agg_categorical_column(series)
1 def agg_categorical_column(series):
----> 2 return [','.join(set(series))]
3

TypeError: sequence item 0: expected str instance, int found

The above exception was the direct cause of the following exception:

TypeError Traceback (most recent call last)
in
----> 1 dfn = build_anonymized_dataset(df, finished_partitions, feature_columns, sensitive_column)

in build_anonymized_dataset(df, partitions, feature_columns, sensitive_column, max_partitions)
12 if max_partitions is not None and i > max_partitions:
13 break
---> 14 grouped_columns = df.loc[partition].agg(aggregations, squeeze=False)
15 sensitive_counts = df.loc[partition].groupby(sensitive_column).agg({sensitive_column : 'count'})
16 values = grouped_columns.iloc[0].to_dict()

D:\anaconda\lib\site-packages\pandas\core\frame.py in aggregate(self, func, axis, *args, **kwargs)
7579 f"incompatible data and dtype: {err}"
7580 )
-> 7581 raise exc from err
7582 if result is None:
7583 return self.apply(func, axis=axis, args=args, **kwargs)

TypeError: DataFrame constructor called with incompatible data and dtype: sequence item 0: expected str instance, int found

[Arigato97]

AttributeError: 'list' object has no attribute 'to_dict' How to solve this mistake, please

[glassonion1]

AttributeError: 'list' object has no attribute 'to_dict' How to solve this mistake, please

I got the same error. this is workaround below.

def agg_categorical_column(series):
    # workearound here
    series.astype('category')
    return [','.join(set(series))]

[XDUqinian]

AttributeError: 'list' object has no attribute 'to_dict' How to solve this mistake, please

I got the same error too. It could be found that the df. agg() returned a Series instead of a Dataframe, so I transformed it. this is workaround below.

grouped_columns = df.loc[partition].agg(aggregations, squeeze=False)
sensitive_counts = df.loc[partition].groupby(sensitive_column).agg({sensitive_column : 'count'})
#insert
df2=grouped_columns.to_frame()
grouped_columns=pd.DataFrame(df2.values.T,columns=df2.index)
#insert_end

[IamWorld]

I was able to make it work, I had to change the file anonypy.py on the lines 79 and 108

Replacing this line

values = grouped_columns.iloc[0].to_dict()

with this one

values= {}
for name,val in grouped_columns.items():
values[name] = val[0]

Hope it helps.