我在使用python的多处理功能优雅地处理键盘中断时遇到问题
（是的，我知道Ctr-C不应该保证正常关机-而是将讨论留给其他线程）
考虑以下代码，我的用户名multiprocessing.Manager#list()是ListProxy，据我了解，该代理处理对列表的多进程访问。
当我从Ctr-C退出时-socket.error: [Errno 2] No such file or directory尝试访问ListProxy时出现提示
我希望共享列表不被Ctr-C破坏。这可能吗？！
注意：我想在不使用池和队列的情况下解决此问题。
from multiprocessing import Process, Manager
from time import sleep
def f(process_number, shared_array):
try:
print "starting thread: ", process_number
shared_array.append(process_number)
sleep(3)
shared_array.append(process_number)
except KeyboardInterrupt:
print "Keyboard interrupt in process: ", process_number
finally:
print "cleaning up thread", process_number
if __name__ == '__main__':
processes = []
manager = Manager()
shared_array = manager.list()
for i in xrange(4):
p = Process(target=f, args=(i, shared_array))
p.start()
processes.append(p)
try:
for process in processes:
process.join()
except KeyboardInterrupt:
print "Keyboard interrupt in main"
for item in shared_array:
# raises "socket.error: [Errno 2] No such file or directory"
print item
如果您运行该命令，然后点击Ctr-C，则会得到以下信息：
starting thread: 0
starting thread: 1
starting thread: 3
starting thread: 2
^CKeyboard interupt in process: 3
Keyboard interupt in process: 0
cleaning up thread 3
cleaning up thread 0
Keyboard interupt in process: 1
Keyboard interupt in process: 2
cleaning up thread 1
cleaning up thread 2
Keyboard interupt in main
Traceback (most recent call last):
File "multi.py", line 33, in <module>
for item in shared_array:
File "<string>", line 2, in __getitem__
File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/managers.py", line 755, in _callmethod
self._connect()
File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/managers.py", line 742, in _connect
conn = self._Client(self._token.address, authkey=self._authkey)
File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/connection.py", line 169, in Client
c = SocketClient(address)
File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/multiprocessing/connection.py", line 293, in SocketClient
s.connect(address)
File "/usr/local/Cellar/python/2.7.3/Frameworks/Python.framework/Versions/2.7/lib/python2.7/socket.py", line 224, in meth
return getattr(self._sock,name)(*args)
socket.error: [Errno 2] No such file or directory
（这是另一种使用multiprocessing.Lock具有相似影响... gist的方法）类似问题：
multiprocessing.Manager（）启动一个子进程，该子进程负责处理您的共享列表代理。
运行时的netstat输出：
UNIX 2 [ACC]流侦听3921657 8457 / python / tmp / pymp-B9dcij / listener-X423Ml
这个由multiprocessing.Manager（）创建的子进程正在捕获您的SIGINT并退出，导致与它相关的任何内容都被取消引用，因此出现“无此类文件”错误（根据我决定发送SIGINT的时间，我还会遇到其他一些错误）。
为了解决这个问题，您可以直接声明一个SyncManager对象（而不是让Manager（）替您完成）。这将需要您使用start（）方法来实际启动子进程。start（）方法将初始化函数作为其第一个参数（您可以在此处为管理器覆盖SIGINT）。
下面的代码，尝试一下：
from multiprocessing import Process, Manager
from multiprocessing.managers import BaseManager, SyncManager
from time import sleep
import signal
#handle SIGINT from SyncManager object
def mgr_sig_handler(signal, frame):
print 'not closing the mgr'
#initilizer for SyncManager
def mgr_init():
signal.signal(signal.SIGINT, mgr_sig_handler)
#signal.signal(signal.SIGINT, signal.SIG_IGN) # <- OR do this to just ignore the signal
print 'initialized mananger'
def f(process_number, shared_array):
try:
print "starting thread: ", process_number
shared_array.append(process_number)
sleep(3)
shared_array.append(process_number)
except KeyboardInterrupt:
print "Keyboard interrupt in process: ", process_number
finally:
print "cleaning up thread", process_number
if __name__ == '__main__':
processes = []
#using syncmanager directly instead of letting Manager() do it for me
manager = SyncManager()
manager.start(mgr_init) #fire up the child manager process
shared_array = manager.list()
for i in xrange(4):
p = Process(target=f, args=(i, shared_array))
p.start()
processes.append(p)
try:
for process in processes:
process.join()
except KeyboardInterrupt:
print "Keyboard interrupt in main"
for item in shared_array:
print item
本文收集自互联网，转载请注明来源。
如有侵权，请联系 [email protected] 删除。
我来说两句