brew安装pip_macOS安装lightgbm2.2.2踩坑记录2019.2

本文仅针对lightgbm 2.2.1之后版本&＃xff0c;之前版本教程较多&＃xff0c;不再详述

之前一直用2.1.0&＃xff0c;折腾zsh&＃xff0c;脑子一抽卸载了brew&＃xff08;脑子是个好东西&＃xff0c;可惜我没有&＃xff09;&＃xff0c;导致原来系统lgb&＃xff0c;xgb全炸了&＃xff0c;重新安装lgb发现和以前的错误完全不一样&＃xff0c;花了一天时间&＃xff0c;终于把这个坑弄清楚了

首先安装前先看下官方github关于python的安装

这段话什么意思&＃xff0c;英语学渣大概解释下&＃xff0c;就是2.2.1之后的版本&＃xff0c;都是Clang编译的&＃xff0c;所以不需要再用gcc编译了&＃xff08;其实编译也能行&＃xff0c;只不过我没注意是警告还是错误&＃xff0c;一直以为后面的错误是安装引起的&＃xff09;&＃xff0c;可以直接使用pip进行安装&＃xff0c;但是&＃xff08;划重点&＃xff01;&＃xff01;&＃xff01;&＃xff09;需要安装OpenMP库

也就是说&＃xff0c;原来的编译&＃xff0c;现在两条命令即可搞定

(关于brew的安装&＃xff0c;也不再多说&＃xff0c;百度不少&＃xff0c;但是在此我还是提醒下&＃xff0c;brew更新慢&＃xff0c;可以通过改镜像源或取消更新来解决&＃xff08;我改镜像源没啥用&＃xff09;&＃xff0c;千万不要和我一样手贱删除&＃xff0c;这就是我悲剧的来源)

取消更新可以参考

取消brew的自动更新 - yf9595的博客 - CSDN博客

安装好以后&＃xff0c;import lightgbm并不会报错&＃xff0c;开始训练模型时会有另一个报错

具体报错如下

OMP: Error #15: Initializing libomp.dylib, but found libiomp5.dylib already initialized.
OMP: Hint This means that multiple copies of the OpenMP runtime have been linked into the program. That is dangerous, since it can degrade performance or cause incorrect results. The best thing to do is to ensure that only a single OpenMP runtime is linked into the process, e.g. by avoiding static linking of the OpenMP runtime in any library. As an unsafe, unsupported, undocumented workaround you can set the environment variable KMP_DUPLICATE_LIB_OK&＃61;TRUE to allow the program to continue to execute, but that may cause crashes or silently produce incorrect results. For more information, please see Support for the OpenMP language

这个问题anaconda已经存在libiomp5.dylib导致的&＃xff08;我之前一直以为是安装的锅。。。&＃xff09;&＃xff0c;百度已有较为完美解决方案&＃xff0c;不再详述&＃xff0c;可以参考

&＃xff08;19.7.19&＃xff0c;再来补充下吧&＃xff0c;训练报错这个问题&＃xff0c;又遇到了&＃xff0c;只不过这次在jupyter里&＃xff0c;运行到train&＃xff0c;kernel直接挂了&＃xff0c;没有任何报错&＃xff0c;仅仅只提示kernel挂了&＃xff0c;也是libiomp5引起&＃xff09;

最后希望无论是老鸟还是萌新&＃xff0c;看到这篇文章都能避免这个坑&＃xff0c;以及感谢群里为我提供帮助的大佬

-------------------------2.11补充-------------------------

由于某些不明原因&＃xff0c;我重启卡进度条了&＃xff0c;又重装了一次系统&＃xff0c;泪奔ing

这次&＃xff0c;在新系统中&＃xff0c;使用anaconda3 5.2.0安装发现了这个报错

根据百度可以明确问题是缺少msgpack 产生的

distributed 1.21.8 requires msgpack, which is not installed.

解决方案

安装完成后&＃xff0c;重新安装lgb