今までunittestとかなかったpython2で動いてたスクリプトがあって、あまりにも変更するのが怖いからとりあえずテスト書いて、CIで動くと便利だよねーって思い
DroneCIの設定を始めました。
まずはこんな感じかなとdrone.ymlを準備しました。
---
kind: pipeline
name: Unit tests
steps:
- name: execute unit test
image: python:2
commands:
- pip install --upgrade pip
- pip install MySQL-Python sqlparse pings paramiko cryptography mock
- python -m unittest discover .
when:
event: [push, pull_request]
そのとき、MySQL-Pythonでこけました。以下のようななんかパッケージがたりてないようなエラーにはまりました。
Failed to build MySQL-Python
94 Installing collected packages: MySQL-Python, sqlparse, pings, ipaddress, pycparser, cffi, enum34, cryptography, pynacl, bcrypt, paramiko, funcsigs, mock
95 Running setup.py install for MySQL-Python: started
96 Running setup.py install for MySQL-Python: finished with status 'error'
97 ERROR: Command errored out with exit status 1:
98 command: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-MVeMp_/mysql-python/setup.py'"'"'; __file__='"'"'/tmp/pip-install-MVeMp_/mysql-python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-avyllU/install-record.txt --single-version-externally-managed --compile --install-headers /usr/local/include/python2.7/MySQL-Python
99 cwd: /tmp/pip-install-MVeMp_/mysql-python/
100 Complete output (38 lines):
101 running install
102 running build
103 running build_py
104 creating build
105 creating build/lib.linux-x86_64-2.7
106 copying _mysql_exceptions.py -> build/lib.linux-x86_64-2.7
107 creating build/lib.linux-x86_64-2.7/MySQLdb
108 copying MySQLdb/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb
109 copying MySQLdb/converters.py -> build/lib.linux-x86_64-2.7/MySQLdb
110 copying MySQLdb/connections.py -> build/lib.linux-x86_64-2.7/MySQLdb
111 copying MySQLdb/cursors.py -> build/lib.linux-x86_64-2.7/MySQLdb
112 copying MySQLdb/release.py -> build/lib.linux-x86_64-2.7/MySQLdb
113 copying MySQLdb/times.py -> build/lib.linux-x86_64-2.7/MySQLdb
114 creating build/lib.linux-x86_64-2.7/MySQLdb/constants
115 copying MySQLdb/constants/__init__.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
116 copying MySQLdb/constants/CR.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
117 copying MySQLdb/constants/FIELD_TYPE.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
118 copying MySQLdb/constants/ER.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
119 copying MySQLdb/constants/FLAG.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
120 copying MySQLdb/constants/REFRESH.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
121 copying MySQLdb/constants/CLIENT.py -> build/lib.linux-x86_64-2.7/MySQLdb/constants
122 running build_ext
123 building '_mysql' extension
124 creating build/temp.linux-x86_64-2.7
125 gcc -pthread -fno-strict-aliasing -g -O2 -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -Dversion_info=(1,2,5,'final',1) -D__version__=1.2.5 -I/usr/include/mariadb -I/usr/include/mariadb/mysql -I/usr/local/include/python2.7 -c _mysql.c -o build/temp.linux-x86_64-2.7/_mysql.o
126 In file included from _mysql.c:44:
127 /usr/include/mariadb/my_config.h:3:2: warning: #warning This file should not be included by clients, include only <mysql.h> [-Wcpp]
128 #warning This file should not be included by clients, include only <mysql.h>
129 ^~~~~~~
130 In file included from _mysql.c:46:
131 /usr/include/mariadb/mysql.h:444:3: warning: function declaration isn’t a prototype [-Wstrict-prototypes]
132 MYSQL_CLIENT_PLUGIN_HEADER
133 ^~~~~~~~~~~~~~~~~~~~~~~~~~
134 _mysql.c: In function ‘_mysql_ConnectionObject_ping’:
135 _mysql.c:2005:41: error: ‘MYSQL’ {aka ‘struct st_mysql’} has no member named ‘reconnect’
136 if ( reconnect != -1 ) self->connection.reconnect = reconnect;
137 ^
138 error: command 'gcc' failed with exit status 1
139 ----------------------------------------
140 ERROR: Command errored out with exit status 1: /usr/local/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-MVeMp_/mysql-python/setup.py'"'"'; __file__='"'"'/tmp/pip-install-MVeMp_/mysql-python/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-avyllU/install-record.txt --single-version-externally-managed --compile --install-headers /usr/local/include/python2.7/MySQL-Python Check the logs for full command output.
普通に調べると、CentOSなら yum -y install python-devel mysql-devel gcc
をインストールする必要があるというのですが、dockerのpython:2のイメージでは、それは無理。
ということで、centos:centos7に変更して実行することにしました。
そして、centos:centos7のイメージでは python-pip
をインストールできないので、epel-releaseを事前にインストールする必要があります。
---
kind: pipeline
name: Unit tests
steps:
- name: execute unit test
image: centos:centos7
commands:
- yum -y install python-devel mysql-devel gcc
- yum -y install epel-release && yum clean all
- yum -y install python2-pip
- pip install --upgrade pip
- pip install MySQL-Python sqlparse pings paramiko cryptography mock
- python -m unittest discover .
when:
event: [push, pull_request]
早くpython3で動くように書き換えたいですね。その前にlintチェックも入れてこれもdroneでチェックできるようにする番だ。