2013-09-21 5 views
2

많은 수의 레이블이있는 다중 레이블 분류 문제를 해결하기 위해 scikit-learn을 사용하고 있습니다. I followed the ideas 프로젝트의 핵심 개발자 중 한 명 (larsmans). 그것은 나에게 런타임 경고와 결국 메모리 오류를 준다. 기능 선택이 포함 된 다중 레이블 분류 (scikit-learn)

>>> clf = Pipeline([('chi2', SelectKBest(chi2, k=1000)),('svm', LinearSVC())]) 
>>> 
>>> multiclf = OneVsRestClassifier(clf, n_jobs=-1) 
>>> 
>>> multiclf.fit(Xtr, ytr) 
/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: 
RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: 
RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157:    
RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 

그리고는 여러 같은 경고 후에는 실패의 모든 MemoryErrors을 Seing

Process PoolWorker-21: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Exception in thread Thread-1: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/threading.py", line 808, in __bootstrap_inner 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/threading.py", line 761, in run 
    self.__target(*self.__args, **self.__kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 325, in _handle_workers 
    pool._maintain_pool() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 229, in _maintain_pool 
    self._repopulate_pool() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 222, in _repopulate_pool 
    w.start() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 130, in start 
    self._popen = Popen(self) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/forking.py", line 121, in __init__ 
    self.pid = os.fork() 
OSError: [Errno 12] Cannot allocate memory 

/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
Process PoolWorker-22: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-23: 
Process PoolWorker-30: 
/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
Process PoolWorker-31: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-28: 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-32: 
Process PoolWorker-29: 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-27: 
Process PoolWorker-26: 
Traceback (most recent call last): 
Process PoolWorker-25: 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self.run() 
    self.run() 
    self.run() 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
    return recv() 
    return recv() 
MemoryError 
MemoryError 
MemoryError 
    return recv() 
MemoryError 
    return recv() 
    return recv() 
MemoryError 
MemoryError 
    return recv() 
MemoryError 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
Process PoolWorker-24: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, 'k'. 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-1: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-2: 
Traceback (most recent call last): 
Process PoolWorker-3: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-4: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-6: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
Process PoolWorker-5: 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-7: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: unpickling stack underflow 
Process PoolWorker-8: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, ''. 
Process PoolWorker-10: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, '�'. 
Process PoolWorker-21: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Exception in thread Thread-1: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/threading.py", line 808, in __bootstrap_inner 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/threading.py", line 761, in run 
    self.__target(*self.__args, **self.__kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 325, in _handle_workers 
    pool._maintain_pool() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 229, in _maintain_pool 
    self._repopulate_pool() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 222, in _repopulate_pool 
    w.start() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 130, in start 
    self._popen = Popen(self) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/forking.py", line 121, in __init__ 
    self.pid = os.fork() 
OSError: [Errno 12] Cannot allocate memory 

/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
Process PoolWorker-22: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-23: 
Process PoolWorker-30: 
/home/rsivapr/scikit-learn/sklearn/feature_selection/univariate_selection.py:157: RuntimeWarning: invalid value encountered in divide 
    chisq /= f_exp 
Process PoolWorker-31: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-28: 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-32: 
Process PoolWorker-29: 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-27: 
Process PoolWorker-26: 
Traceback (most recent call last): 
Process PoolWorker-25: 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Traceback (most recent call last): 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self.run() 
    self.run() 
    self.run() 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
    return recv() 
    return recv() 
MemoryError 
MemoryError 
MemoryError 
    return recv() 
MemoryError 
    return recv() 
    return recv() 
MemoryError 
MemoryError 
    return recv() 
MemoryError 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
Process PoolWorker-24: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, 'k'. 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-1: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-2: 
Traceback (most recent call last): 
Process PoolWorker-3: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-4: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
Process PoolWorker-6: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
Process PoolWorker-5: 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
    return recv() 
MemoryError 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
MemoryError 
Process PoolWorker-7: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: unpickling stack underflow 
Process PoolWorker-8: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, ''. 
Process PoolWorker-10: 
Traceback (most recent call last): 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap 
    self.run() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/process.py", line 114, in run 
    self._target(*self._args, **self._kwargs) 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/pool.py", line 102, in worker 
    task = get() 
    File "/home/rsivapr/anaconda/lib/python2.7/multiprocessing/queues.py", line 376, in get 
    return recv() 
UnpicklingError: invalid load key, '�'. 

답변

0

아래의 오류 덤프, 당신은 메모리가 부족 가능성이 실행했습니다. n_jobs = -1을 n_jobs = 1로 바꾸어보십시오. 이것은 생성 된 프로세스의 양 (따라서 사용 된 메모리의 양)을 제어합니다.

메모리가 부족하지 않으면 n_jobs = 2, n_jobs = 3 등과 같이 n_jobs를 늘릴 수 있습니다.

관련 문제