色综合图-色综合图片-色综合图片二区150p-色综合图区-玖玖国产精品视频-玖玖香蕉视频

您的位置:首頁技術文章
文章詳情頁

python中threading和queue庫實現多線程編程

瀏覽:107日期:2022-06-28 11:01:13
摘要

本文主要介紹了利用python的 threading和queue庫實現多線程編程,并封裝為一個類,方便讀者嵌入自己的業務邏輯。最后以機器學習的一個超參數選擇為例進行演示。

多線程實現邏輯封裝

實例化該類后,在.object_func函數中加入自己的業務邏輯,再調用.run方法即可。

# -*- coding: utf-8 -*-# @Time : 2021/2/4 14:36# @Author : CyrusMay WJ# @FileName: run.py# @Software: PyCharm# @Blog :https://blog.csdn.net/Cyrus_Mayimport queueimport threadingclass CyrusThread(object): def __init__(self,num_thread = 10,logger=None): ''':param num_thread: 線程數 :param logger: 日志對象 ''' self.num_thread = num_thread self.logger = logger def object_func(self,args_queue,max_q): while 1: try:arg = args_queue.get_nowait()step = args_queue.qsize()self.logger.info('progress:{}{}'.format(max_q,step)) except:self.logger.info('no more arg for args_queue!')break'''此處加入自己的業務邏輯代碼''' def run(self,args): args_queue = queue.Queue() for value in args: args_queue.put(value) threads = [] for i in range(self.num_thread): threads.append(threading.Thread(target=self.object_func,args = args_queue)) for t in threads: t.start() for t in threads: t.join()

模型參數選擇實例

# -*- coding: utf-8 -*-# @Time : 2021/2/4 14:36# @Author : CyrusMay WJ# @FileName: run.py# @Software: PyCharm# @Blog :https://blog.csdn.net/Cyrus_Mayimport queueimport threadingimport numpy as npfrom sklearn.datasets import load_bostonfrom sklearn.svm import SVRimport loggingimport sysclass CyrusThread(object): def __init__(self,num_thread = 10,logger=None): ''' :param num_thread: 線程數 :param logger: 日志對象 ''' self.num_thread = num_thread self.logger = logger def object_func(self,args_queue,max_q): while 1: try:arg = args_queue.get_nowait()step = args_queue.qsize()self.logger.info('progress:{}{}'.format(max_q,max_q-step)) except:self.logger.info('no more arg for args_queue!')break # 業務代碼 C, epsilon, gamma = arg[0], arg[1], arg[2] svr_model = SVR(C=C, epsilon=epsilon, gamma=gamma) x, y = load_boston()['data'], load_boston()['target'] svr_model.fit(x, y) self.logger.info('score:{}'.format(svr_model.score(x,y))) def run(self,args): args_queue = queue.Queue() max_q = 0 for value in args: args_queue.put(value) max_q += 1 threads = [] for i in range(self.num_thread): threads.append(threading.Thread(target=self.object_func,args = (args_queue,max_q))) for t in threads: t.start() for t in threads: t.join()# 創建日志對象logger = logging.getLogger()logger.setLevel(logging.INFO)screen_handler = logging.StreamHandler(sys.stdout)screen_handler.setLevel(logging.INFO)formatter = logging.Formatter(’%(asctime)s - %(module)s.%(funcName)s:%(lineno)d - %(levelname)s - %(message)s’)screen_handler.setFormatter(formatter)logger.addHandler(screen_handler)# 創建需要調整參數的集合args = []for C in [i for i in np.arange(0.01,1,0.01)]: for epsilon in [i for i in np.arange(0.001,1,0.01)] + [i for i in range(1,10,1)]: for gamma in [i for i in np.arange(0.001,1,0.01)] + [i for i in range(1,10,1)]: args.append([C,epsilon,gamma])# 創建多線程工具threading_tool = CyrusThread(num_thread=20,logger=logger)threading_tool.run(args)

運行結果

2021-02-04 20:52:22,824 - run.object_func:31 - INFO - progress:117621912021-02-04 20:52:22,824 - run.object_func:31 - INFO - progress:117621922021-02-04 20:52:22,826 - run.object_func:31 - INFO - progress:117621932021-02-04 20:52:22,833 - run.object_func:31 - INFO - progress:117621942021-02-04 20:52:22,837 - run.object_func:31 - INFO - progress:117621952021-02-04 20:52:22,838 - run.object_func:31 - INFO - progress:117621962021-02-04 20:52:22,841 - run.object_func:31 - INFO - progress:117621972021-02-04 20:52:22,862 - run.object_func:31 - INFO - progress:117621982021-02-04 20:52:22,873 - run.object_func:31 - INFO - progress:117621992021-02-04 20:52:22,884 - run.object_func:31 - INFO - progress:1176219102021-02-04 20:52:22,885 - run.object_func:31 - INFO - progress:1176219112021-02-04 20:52:22,897 - run.object_func:31 - INFO - progress:1176219122021-02-04 20:52:22,900 - run.object_func:31 - INFO - progress:1176219132021-02-04 20:52:22,904 - run.object_func:31 - INFO - progress:1176219142021-02-04 20:52:22,912 - run.object_func:31 - INFO - progress:1176219152021-02-04 20:52:22,920 - run.object_func:31 - INFO - progress:1176219162021-02-04 20:52:22,920 - run.object_func:39 - INFO - score:-0.016742839142878552021-02-04 20:52:22,929 - run.object_func:31 - INFO - progress:1176219172021-02-04 20:52:22,932 - run.object_func:39 - INFO - score:-0.0079923541709525652021-02-04 20:52:22,932 - run.object_func:31 - INFO - progress:1176219182021-02-04 20:52:22,945 - run.object_func:31 - INFO - progress:1176219192021-02-04 20:52:22,954 - run.object_func:31 - INFO - progress:1176219202021-02-04 20:52:22,978 - run.object_func:31 - INFO - progress:1176219212021-02-04 20:52:22,984 - run.object_func:39 - INFO - score:-0.0187699348072465362021-02-04 20:52:22,985 - run.object_func:31 - INFO - progress:117621922

到此這篇關于python中threading和queue庫實現多線程編程的文章就介紹到這了,更多相關python 多線程編程內容請搜索好吧啦網以前的文章或繼續瀏覽下面的相關文章希望大家以后多多支持好吧啦網!

標簽: Python 編程
相關文章:
主站蜘蛛池模板: 99国产精品久久久久久久... | 日韩经典视频 | 特黄特色一级特色大片中文 | 中文乱码字幕午夜无线观看 | 国产区一区二 | 国产男人的天堂 | 久久―日本道色综合久久 | 国产精品成人一区二区 | 91国内精品久久久久免费影院 | 久久精品在现线观看免费15 | 中文字幕 亚洲精品 第1页 | 热99re久久精品2久久久 | 国产国产人免费人成成免视频 | 美国a毛片| 色老久久精品偷偷鲁一区 | 国产三级国产精品国产普男人 | 分享一个无毒不卡免费国产 | 成年人网站在线观看免费 | 免费三级网站 | 国产肥老妇视频一 | 日本精品一区二区三区在线视频一 | 亚洲欧美日韩高清综合678 | 欧美三级视频在线观看 | 日本不卡高清免费 | 啪啪自拍| 久久国产免费 | 在线高清免费爱做网 | 亚洲精品国产一区二区在线 | a毛片免费观看完整 | www中文字幕| 爽爽窝窝午夜精品一区二区 | 欧美在线视频精品 | 亚洲伊人成人 | 欧美成人亚洲欧美成人 | 成人免费观看一区二区 | 亚洲欧洲一二三区机械有限公司 | 俺来也欧美亚洲a∨在线 | a毛片全部播放免费视频完整18 | 特级片在线观看 | 亚洲精品国产经典一区二区 | 男人和女人搞黄 |