numpy - Problems installing nimfa (Python Matrix Factorization library) -
i have large (~25000 x 1000) matrix factorize. wrote own code based on numpy, it's inefficient , keeps throwing memory error.
i've been trying install , use nimfa (http://nimfa.biolab.si/) , install process (tried easy_install, pip, , downloading , running git) doesn't show errors. when try call using import nimfa below error. checked nimfa prerequisites , doesn't mention besides numpy , scipy.
i'm on windows 8, , using python 2.7.5 numpy , scipy installed. i've tried installing (and subsequently uninstalling) mingw , doing this.
any ideas?
traceback (most recent call last): file "<pyshell#0>", line 1, in <module> import nimfa file "c:\python27\lib\site-packages\nimfa-1.0-py2.7.egg\nimfa\__init__.py", line 18, in <module> mf_run import * file "c:\python27\lib\site-packages\nimfa-1.0-py2.7.egg\nimfa\mf_run.py", line 26, in <module> utils import * file "c:\python27\lib\site-packages\nimfa-1.0-py2.7.egg\nimfa\utils\__init__.py", line 8, in <module> import linalg file "c:\python27\lib\site-packages\nimfa-1.0-py2.7.egg\nimfa\utils\linalg.py", line 15, in <module> import scipy.sparse.linalg sla file "c:\python27\lib\site-packages\scipy\sparse\linalg\__init__.py", line 100, in <module> .isolve import * file "c:\python27\lib\site-packages\scipy\sparse\linalg\isolve\__init__.py", line 6, in <module> .iterative import * file "c:\python27\lib\site-packages\scipy\sparse\linalg\isolve\iterative.py", line 7, in <module> . import _iterative importerror: dll load failed: specified module not found.`
if purpose factorize matrix rather use nimfa it, suggest using dask instead. dask designed make possible complete operations on data objects fit on disk not in memory minimal changes code. working example:
import dask.array da import numpy np import dask mtx = da.from_array(np.random.normal(size=(25000, 1000)), chunks=(250, 20)) q, r = np.linalg.qr(mtx) you may need tune chunks parameter fit computing resources (see faqs advice on that).
Comments
Post a Comment