Pandas pivot to sparse

from scipy.sparse import csr_matrix
from pandas.api.types import CategoricalDtype

person_c = CategoricalDtype(sorted(frame.person.unique()), ordered=True)
thing_c = CategoricalDtype(sorted(frame.thing.unique()), ordered=True)

row = frame.person.astype(person_c).cat.codes
col = frame.thing.astype(thing_c).cat.codes
sparse_matrix = csr_matrix((frame["count"], (row, col)), \
                           shape=(person_c.categories.size, thing_c.categories.size))

>>> sparse_matrix
<3x4 sparse matrix of type '<class 'numpy.int64'>'
     with 6 stored elements in Compressed Sparse Row format>

>>> sparse_matrix.todense()
matrix([[0, 1, 0, 1],
        [1, 0, 0, 1],
        [1, 0, 1, 0]], dtype=int64)


dfs = pd.SparseDataFrame(sparse_matrix, \
                         index=person_c.categories, \
                         columns=thing_c.categories, \
                         default_fill_value=0)
>>> dfs
        a   b   c   d
 him    0   1   0   1
  me    1   0   0   1
 you    1   0   1   0

Source: stackoverflow.com

Similar codes

7 votes112 views5 answers
Python get parent directory
Python
2 votes80 views1 answer
Jupyter lab
Python
0 vote115 views1 answer
How to load user from jwt token request django
Python
1 vote112 views1 answer
Addition/subtraction of integers and integer-arrays with DatetimeArray is no longer supported
Python
0 vote159 views2 answers
Where should favicon.ico be placed in flask app
Python Flask
1 vote107 views1 answer
Fatal error detected failed to execute script
Python
0 vote161 views6 answers
Nlp generate parse tree in python
Python
40 votes113 views6 answers
Reset index pandas
Python
4 votes105 views3 answers
Read csv without header pandas
Python
0 vote132 views1 answer
Dense rank in pandas
Python