Pandas pivot to sparse

from scipy.sparse import csr_matrix
from pandas.api.types import CategoricalDtype

person_c = CategoricalDtype(sorted(frame.person.unique()), ordered=True)
thing_c = CategoricalDtype(sorted(frame.thing.unique()), ordered=True)

row = frame.person.astype(person_c).cat.codes
col = frame.thing.astype(thing_c).cat.codes
sparse_matrix = csr_matrix((frame["count"], (row, col)), \
                           shape=(person_c.categories.size, thing_c.categories.size))

>>> sparse_matrix
<3x4 sparse matrix of type '<class 'numpy.int64'>'
     with 6 stored elements in Compressed Sparse Row format>

>>> sparse_matrix.todense()
matrix([[0, 1, 0, 1],
        [1, 0, 0, 1],
        [1, 0, 1, 0]], dtype=int64)


dfs = pd.SparseDataFrame(sparse_matrix, \
                         index=person_c.categories, \
                         columns=thing_c.categories, \
                         default_fill_value=0)
>>> dfs
        a   b   c   d
 him    0   1   0   1
  me    1   0   0   1
 you    1   0   1   0

Source: stackoverflow.com

Similar codes

2 votes159 views2 answers
Say command python
Python
5 votes168 views2 answers
How to run a function in interval in python
Python
0 vote159 views2 answers
Gcp jupyter use python variables in magic bigquery
Python
11 votes167 views4 answers
Sorted python lambda
Python
-2 votes135 views1 answer
How to get data from django session
Python
9 votes117 views1 answer
Pandas sort by multiple columns
Python
52 votes141 views6 answers
Python new line
Python
0 vote193 views1 answer
Python regex (\d)(?=\d\1)
Python
0 vote147 views2 answers
Make gif from images in python
Python
0 vote194 views4 answers
Django-sslserver · PyPI
Python Django