Pandas pivot to sparse

from scipy.sparse import csr_matrix
from pandas.api.types import CategoricalDtype

person_c = CategoricalDtype(sorted(frame.person.unique()), ordered=True)
thing_c = CategoricalDtype(sorted(frame.thing.unique()), ordered=True)

row = frame.person.astype(person_c).cat.codes
col = frame.thing.astype(thing_c).cat.codes
sparse_matrix = csr_matrix((frame["count"], (row, col)), \
                           shape=(person_c.categories.size, thing_c.categories.size))

>>> sparse_matrix
<3x4 sparse matrix of type '<class 'numpy.int64'>'
     with 6 stored elements in Compressed Sparse Row format>

>>> sparse_matrix.todense()
matrix([[0, 1, 0, 1],
        [1, 0, 0, 1],
        [1, 0, 1, 0]], dtype=int64)


dfs = pd.SparseDataFrame(sparse_matrix, \
                         index=person_c.categories, \
                         columns=thing_c.categories, \
                         default_fill_value=0)
>>> dfs
        a   b   c   d
 him    0   1   0   1
  me    1   0   0   1
 you    1   0   1   0

Source: stackoverflow.com

Similar codes

10 votes166 views4 answers
Add row to dataframe with index
Python
0 vote137 views1 answer
Python array set key value
Python
0 vote140 views1 answer
Numpy get index of n largest values
Python
1 vote150 views1 answer
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available()
Python
3 votes166 views1 answer
Python regex match words
Python
1 vote159 views2 answers
How to connect ip camera to opencv python
Python
1 vote181 views1 answer
How to add decorators with class in django
Python Django
0 vote182 views1 answer
How to display printed values without scientific notation python
Python
3 votes136 views5 answers
Calc
Python
1 vote142 views1 answer
Final class variable python
Python