Python多進(jìn)程編程常用方法解析
python中的多線程其實(shí)并不是真正的多線程,如果想要充分地使用多核CPU資源,在python中大部分情況需要使用多進(jìn)程。python提供了非常好用的多進(jìn)程包Multiprocessing,只需要定義一個(gè)函數(shù),python會(huì)完成其它所有事情。借助這個(gè)包,可以輕松完成從單進(jìn)程到并發(fā)執(zhí)行的轉(zhuǎn)換。multiprocessing支持子進(jìn)程、通信和共享數(shù)據(jù)、執(zhí)行不同形式的同步,提供了Process、Queue、Pipe、LocK等組件
一、Process
語法:Process([group[,target[,name[,args[,kwargs]]]]])
參數(shù)含義:target表示調(diào)用對(duì)象;args表示調(diào)用對(duì)象的位置參數(shù)元祖;kwargs表示調(diào)用對(duì)象的字典。name為別名,groups實(shí)際上不會(huì)調(diào)用。
方法:is_alive():
join(timeout):
run():
start():
terminate():
屬性:authkey、daemon(要通過start()設(shè)置)、exitcode(進(jìn)程在運(yùn)行時(shí)為None、如果為-N,表示被信號(hào)N結(jié)束)、name、pid。其中daemon是父進(jìn)程終止后自動(dòng)終止,且自己不能產(chǎn)生新的進(jìn)程,必須在start()之前設(shè)置。
1.創(chuàng)建函數(shù),并將其作為單個(gè)進(jìn)程
from multiprocessing import Processdef func(name): print('%s曾經(jīng)是好人'%name)if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) p.start() #start()通知系統(tǒng)開啟這個(gè)進(jìn)程
2.創(chuàng)建函數(shù)并將其作為多個(gè)進(jìn)程
from multiprocessing import Processimport random,timedef hobby_motion(name): print(’%s喜歡運(yùn)動(dòng)’% name) time.sleep(random.randint(1,3))def hobby_game(name): print(’%s喜歡游戲’% name) time.sleep(random.randint(1,3))if __name__ == '__main__': p1 = Process(target=hobby_motion,args=(’付婷婷’,)) p2 = Process(target=hobby_game,args=(’科比’,)) p1.start() p2.start()
執(zhí)行結(jié)果:
付婷婷喜歡運(yùn)動(dòng)科比喜歡游戲
3.將進(jìn)程定義為類(開啟進(jìn)程的另一種方法,并不是很常用)
from multiprocessing import Processclass MyProcess(Process): def __init__(self,name): super().__init__() self.name = name def run(self): #start()時(shí),run自動(dòng)調(diào)用,而且此處只能定義為run。 print('%s曾經(jīng)是好人'%self.name)if __name__ == '__main__': p = MyProcess(’kebi’) p.start() #將Process當(dāng)作父類,并且自定義一個(gè)函數(shù)。
4.daemon程序?qū)Ρ刃Ч?/b>
不加daemon屬性
import timedef func(name): print('work start:%s'% time.ctime()) time.sleep(2) print('work end:%s'% time.ctime())if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) p.start() print('this is over')#執(zhí)行結(jié)果this is overwork start:Thu Nov 30 16:12:00 2017work end:Thu Nov 30 16:12:02 2017
加上daemon屬性
from multiprocessing import Processimport timedef func(name): print('work start:%s'% time.ctime()) time.sleep(2) print('work end:%s'% time.ctime())if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) p.daemon = True #父進(jìn)程終止后自動(dòng)終止,不能產(chǎn)生新進(jìn)程,必須在start()之前設(shè)置 p.start() print('this is over')#執(zhí)行結(jié)果this is over
設(shè)置了daemon屬性又想執(zhí)行完的方法:
import timedef func(name): print('work start:%s'% time.ctime()) time.sleep(2) print('work end:%s'% time.ctime())if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) p.daemon = True p.start() p.join() #執(zhí)行完前面的代碼再執(zhí)行后面的 print('this is over')#執(zhí)行結(jié)果work start:Thu Nov 30 16:18:39 2017work end:Thu Nov 30 16:18:41 2017this is over
5.join():上面的代碼執(zhí)行完畢之后,才會(huì)執(zhí)行后i面的代碼。
先看一個(gè)例子:
from multiprocessing import Processimport time,os,randomdef func(name,hour): print('A lifelong friend:%s,%s'% (name,os.getpid())) time.sleep(hour) print('Good bother:%s'%name)if __name__ == '__main__': p = Process(target=func,args=(’kebi’,2)) p1 = Process(target=func,args=(’maoxian’,1)) p2 = Process(target=func,args=(’xiaoniao’,3)) p.start() p1.start() p2.start() print('this is over')
執(zhí)行結(jié)果:
this is over #最后執(zhí)行,最先打印,說明start()只是開啟進(jìn)程,并不是說一定要執(zhí)行完A lifelong friend:kebi,12048A lifelong friend:maoxian,8252A lifelong friend:xiaoniao,6068Good bother:maoxian #最先打印,第二位執(zhí)行Good bother:kebi Good bother:xiaoniao
添加join()
from multiprocessing import Processimport time,os,randomdef func(name,hour): print('A lifelong friend:%s,%s'% (name,os.getpid())) time.sleep(hour) print('Good bother:%s'%name)start = time.time()if __name__ == '__main__': p = Process(target=func,args=(’kebi’,2)) p1 = Process(target=func,args=(’maoxian’,1)) p2 = Process(target=func,args=(’xiaoniao’,3)) p.start() p.join() #上面的代碼執(zhí)行完畢之后,再執(zhí)行后面的 p1.start() p1.join() p2.start() p2.join() print('this is over') print(time.time() - start)#執(zhí)行結(jié)果A lifelong friend:kebi,14804Good bother:kebiA lifelong friend:maoxian,11120Good bother:maoxianA lifelong friend:xiaoniao,10252 #每個(gè)進(jìn)程執(zhí)行完了,才會(huì)執(zhí)行下一個(gè)Good bother:xiaoniaothis is over6.497815370559692 #2+1+3+主程序執(zhí)行時(shí)間
改變一下位置
from multiprocessing import Processimport time,os,randomdef func(name,hour): print('A lifelong friend:%s,%s'% (name,os.getpid())) time.sleep(hour) print('Good bother:%s'%name)start = time.time()if __name__ == '__main__': p = Process(target=func,args=(’kebi’,2)) p1 = Process(target=func,args=(’maoxian’,1)) p2 = Process(target=func,args=(’xiaoniao’,3)) p.start() p1.start() p2.start() p.join() #需要2秒 p1.join() #到這時(shí)已經(jīng)執(zhí)行完 p2.join() #已經(jīng)執(zhí)行了2秒,還要1秒 print('this is over') print(time.time() - start)#執(zhí)行結(jié)果A lifelong friend:kebi,13520A lifelong friend:maoxian,11612A lifelong friend:xiaoniao,17064 #幾乎是同時(shí)開啟執(zhí)行Good bother:maoxianGood bother:kebiGood bother:xiaoniaothis is over3.273620367050171 #以最長(zhǎng)時(shí)間的為主
6.其它屬性和方法
from multiprocessing import Processimport timedef func(name): print('work start:%s'% time.ctime()) time.sleep(2) print('work end:%s'% time.ctime())if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) p.start() p.terminate() #將進(jìn)程殺死,而且必須放在start()后面,與daemon的功能類似#執(zhí)行結(jié)果this is over
from multiprocessing import Processimport timedef func(name): print('work start:%s'% time.ctime()) time.sleep(2) print('work end:%s'% time.ctime())if __name__ == '__main__': p = Process(target=func,args=(’kebi’,)) # p.daemon = True print(p.is_alive()) p.start() print(p.name) #獲取進(jìn)程的名字 print(p.pid) #獲取進(jìn)程的pid print(p.is_alive()) #判斷進(jìn)程是否存在 print('this is over')
以上就是本文的全部?jī)?nèi)容,希望對(duì)大家的學(xué)習(xí)有所幫助,也希望大家多多支持好吧啦網(wǎng)。
相關(guān)文章:
