持续集成之代码质量管理Sonar(六)

Sonar 是一个用于代码质量管理的开放平台。通过插件机制&＃xff0c;Sonar可以集成不同的测试工具&＃xff0c;代码分析工具&＃xff0c;以及持续集成工具。与持续集成工具&＃xff08;例如 Hudson/Jenkins 等&＃xff09;不同&＃xff0c;Sonar 并不是简单地把不同的代码检查工具结果&＃xff08;例如 FindBugs&＃xff0c;PMD 等&＃xff09;直接显示在 Web 页面上&＃xff0c;而是通过不同的插件对这些结果进行再加工处理&＃xff0c;通过量化的方式度量代码质量的变化&＃xff0c;从而可以方便地对不同规模和种类的工程进行代码质量管理。

在对其他工具的支持方面&＃xff0c;Sonar 不仅提供了对 IDE 的支持&＃xff0c;可以在 Eclipse和 IntelliJ IDEA 这些工具里联机查看结果&＃xff1b;同时 Sonar 还对大量的持续集成工具提供了接口支持&＃xff0c;可以很方便地在持续集成中使用 Sonar。

此外&＃xff0c;Sonar 的插件还可以对 Java 以外的其他编程语言提供支持&＃xff0c;对国际化以及报告文档化也有良好的支持。

Sonar 的相关下载和文档可以在下面的链接中找到&＃xff1a;http://www.sonarqube.org/downloads 。 需要注意最新版的 Sonar 需要至少JDK 1.8及以上版本。

之前我们已经可以成功的使用 git 进行拉取&＃xff0c;Sonar 的功能就是来检查代码是否有BUG。除了检查代码是否有 bug 还有其他的功能&＃xff0c;比如说&＃xff1a;你的代码注释率是多少&＃xff0c;代码有一些建议&＃xff0c;编写语法的建议。所以我们叫质量管理

Sonar 还可以给代码打分&＃xff0c;并且引用了技术宅的功能&＃xff08;告诉你有很多地方没改&＃xff09;

1、安装 jdk

JDK 可以去 Oracle 官网去下载&＃xff0c;也可以使用 yum 仓库的 JDK。

rpm -ivh jdk-8u45-linux-x64.rpm

2、下载安装包

我这里下载的是长期维护的一个版本6.7.5。

wget https://sonarsource.bintray.com/Distribution/sonarqube/sonarqube-6.7.5.zip

3、解压

unzip sonarqube-6.7.5.zip
mv sonarqube-6.7.5 /usr/local/sonarqube 三、准备数据库

因为 sonar 会用到数据库&＃xff0c;所以我们要事先准备好数据库&＃xff0c;它支持多种数据库&＃xff0c;我们这里选择的是 MySQL/Mariadb&＃xff0c;注意 MySQL 的版本最低要5.6&＃xff0c;因为我这里有现有的数据库&＃xff0c;所以安装过程省略。

mysql> CREATE DATABASE sonar CHARACTER SET utf8 COLLATE utf8_general_ci;
mysql> GRANT ALL ON sonar.* TO &＃39;sonar&＃39;&＃64;&＃39;localhost&＃39; IDENTIFIED BY &＃39;sonar&＃64;pw&＃39;;
mysql> GRANT ALL ON sonar.* TO &＃39;sonar&＃39;&＃64;&＃39;%&＃39; IDENTIFIED BY &＃39;sonar&＃64;pw&＃39;;
mysql> FLUSH PRIVILEGES; 四、配置 Sonar

1、配置数据库连接

编辑/usr/local/sonarqube/conf/sonar.properties&＃xff0c;修改内容如下&＃xff1a;

# 数据库连接
sonar.jdbc.username&＃61;sonar
sonar.jdbc.password&＃61;sonar&＃64;pw
sonar.jdbc.url&＃61;jdbc:mysql://10.0.1.13:3306/sonar?useUnicode&＃61;true&characterEncoding&＃61;utf8&rewriteBatchedStatements&＃61;true&useConfigs&＃61;maxPerformance&useSSL&＃61;false# Web 端口
sonar.web.host&＃61;0.0.0.0
sonar.web.port&＃61;9000

2、创建用户 sonar

因为程序不允许我们使用 root 执行&＃xff0c;所以我们需要注册一个普通用户

useradd sonar
chown sonar.sonar /usr/local/sonarqube -R

3、启动 sonar

[root&＃64;monitor ~]# su - sonar[sonar&＃64;monitor ~]$ /usr/local/sonarqube/bin/linux-x86-64/sonar.sh start
Starting SonarQube...
Started SonarQube.

4、检查是否启动成功

[root&＃64;monitor ~]# netstat -tlnp
Active Internet connections (only servers)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 127.0.0.1:32000 0.0.0.0:* LISTEN 8126/java
tcp 0 0 0.0.0.0:10050 0.0.0.0:* LISTEN 1804/zabbix_agentd
tcp 0 0 0.0.0.0:10051 0.0.0.0:* LISTEN 2202/zabbix_server
tcp 0 0 0.0.0.0:873 0.0.0.0:* LISTEN 16611/rsync
tcp 0 0 0.0.0.0:3306 0.0.0.0:* LISTEN 2040/mysqld
tcp 0 0 0.0.0.0:22 0.0.0.0:* LISTEN 1586/sshd
tcp 0 0 127.0.0.1:25 0.0.0.0:* LISTEN 1677/master
tcp 0 0 ::ffff:127.0.0.1:8005 :::* LISTEN 16486/java
tcp 0 0 :::9000 :::* LISTEN 8258/java
tcp 0 0 ::ffff:127.0.0.1:9001 :::* LISTEN 8151/java
tcp 0 0 :::873 :::* LISTEN 16611/rsync
tcp 0 0 :::8080 :::* LISTEN 16486/java
tcp 0 0 :::80 :::* LISTEN 4841/httpd 五、登录 sonar

Web登录&＃xff1a;IP:9000

sonar跟jenkins类似&＃xff0c;也是以插件为主。
sonar安装插件有2种方式&＃xff1a;第一种将插件下载完存放在sonar的插件目录&＃xff0c;第二种使用web界面来使用安装存放插件路径[/usr/local/sonarqube/extensions/plugins/]。

1、安装中文插件

登陆&＃xff1a;用户名&＃xff1a;admin 密码&＃xff1a;admin。

重启才会生效。

生效后界面如下。

和 jenkins 一样&＃xff0c;需要什么插件直接去应用市场下载即可。

2、安装 sonar 扫描器

Sonar通过SonarQube Scanner&＃xff08;扫描器&＃xff09;来对代码进行分析。

wget https://sonarsource.bintray.com/Distribution/sonar-scanner-cli/sonar-scanner-2.8.zip
unzip sonar-scanner-2.8.zip
mv sonar-scanner-2.8 /usr/local/sonar-scanner

3、扫描器和 sonar 关联起来

编辑文件/usr/local/sonar-scanner/conf/sonar-scanner.properties&＃xff0c;修改为如下内容&＃xff1a;

sonar.host.url&＃61;http://localhost:9000
sonar.sourceEncoding&＃61;UTF-8 六、代码扫描

1、下载代码

sonar 插件提供了一个测试的代码库。
github&＃xff1a;https://github.com/SonarSource/sonar-scanning-examples
下载地址&＃xff1a;https://codeload.github.com/SonarSource/sonar-scanning-examples/zip/master

wget https://codeload.github.com/SonarSource/sonar-scanning-examples/zip/master
unzip master
cd sonar-scanning-examples-master/sonarqube-scanner

2、sonar-project.properties

我们会看到项目下面有一个文件 sonar-project.properties&＃xff0c;如果想要代码被扫描&＃xff0c;就需要在代码路径下放一个配置文件。

[root&＃64;monitor sonarqube-scanner]# cat sonar-project.properties
sonar.projectKey&＃61;org.sonarqube:sonarqube-scanner #Key
sonar.projectName&＃61;Example of SonarQube Scanner Usage #这里的名称会显示在web上面
sonar.projectVersion&＃61;1.0 #版本&＃xff0c;也会显示在web上面
sonar.sources&＃61;src #软件包存放路径
sonar.sourceEncoding&＃61;UTF-8 #字体编码

3、扫描

需要在项目文件里面进行执行&＃xff0c;程序会在当面目录下扫描sonar-project.properties文件&＃xff0c;根据配置文件进行扫描工作。扫描之后我们在web界面上就可以看到代码的扫描结果。

[root&＃64;monitor sonarqube-scanner]# /usr/local/sonar-scanner/bin/sonar-scanner
INFO: Scanner configuration file: /usr/local/sonar-scanner/conf/sonar-scanner.properties
INFO: Project root configuration file: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner/sonar-project.properties
INFO: SonarQube Scanner 2.8
INFO: Java 1.8.0_45 Oracle Corporation (64-bit)
INFO: Linux 2.6.32-573.el6.x86_64 amd64
INFO: User cache: /root/.sonar/cache
INFO: Publish mode
INFO: Load global settings
INFO: Load global settings (done) | time&＃61;67ms
INFO: Server id: A737A953-AWVGKXYQugQwgVmc5Jb0
INFO: User cache: /root/.sonar/cache
INFO: Load plugins index
INFO: Load plugins index (done) | time&＃61;48ms
INFO: Plugin [l10nzh] defines &＃39;l10nen&＃39; as base plugin. This metadata can be removed from manifest of l10n plugins since version 5.2.
INFO: SonarQube server 6.7.5
INFO: Default locale: "en_US", source code encoding: "UTF-8"
INFO: Process project properties
INFO: Load project repositories
INFO: Load project repositories (done) | time&＃61;113ms
INFO: Load quality profiles
INFO: Load quality profiles (done) | time&＃61;28ms
INFO: Load active rules
INFO: Load active rules (done) | time&＃61;416ms
INFO: Load metrics repository
INFO: Load metrics repository (done) | time&＃61;23ms
WARN: SCM provider autodetection failed. No SCM provider claims to support this project. Please use sonar.scm.provider to define SCM of your project.
INFO: Project key: org.sonarqube:sonarqube-scanner
INFO: ------------- Scan Example of SonarQube Scanner Usage
INFO: Load server rules
INFO: Load server rules (done) | time&＃61;49ms
INFO: Base dir: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner
INFO: Working dir: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner/.sonar
INFO: Source paths: src, copybooks
INFO: Source encoding: UTF-8, default locale: en_US
INFO: Index files
INFO: 36 files indexed
INFO: Quality profile for flex: Sonar way
INFO: Quality profile for js: Sonar way
INFO: Quality profile for php: Sonar way
INFO: Quality profile for py: Sonar way
INFO: Quality profile for xml: Sonar way
INFO: Sensor PythonXUnitSensor [python]
INFO: Sensor PythonXUnitSensor [python] (done) | time&＃61;10ms
INFO: Sensor Python Squid Sensor [python]
INFO: Python unit test coverage
INFO: Python integration test coverage
INFO: Python overall test coverage
INFO: Sensor Python Squid Sensor [python] (done) | time&＃61;271ms
INFO: Sensor SonarJavaXmlFileSensor [java]
INFO: 1 source files to be analyzed
INFO: Sensor SonarJavaXmlFileSensor [java] (done) | time&＃61;71ms
INFO: 1/1 source files have been analyzed
INFO: Sensor Flex [flex]
INFO: 2 source files to be analyzed
INFO: 2/2 source files have been analyzed
INFO: Sensor Flex [flex] (done) | time&＃61;98ms
INFO: Sensor Flex Cobertura [flex]
INFO: Analyzing Cobertura report: coverage-report/coverage-cobertua-flex.xml
WARN: Using absolute path pattern is deprecated. Please use relative path instead of &＃39;file:**/Circle.as&＃39;
WARN: Using absolute path pattern is deprecated. Please use relative path instead of &＃39;file:**/UncoveredCircle.as&＃39;
INFO: Sensor Flex Cobertura [flex] (done) | time&＃61;62ms
INFO: Sensor XML Sensor [xml]
INFO: Sensor XML Sensor [xml] (done) | time&＃61;125ms
INFO: Sensor PHP sensor [php]
INFO: 1 source files to be analyzed
INFO: 1/1 source files have been analyzed
INFO: No PHPUnit test report provided (see &＃39;sonar.php.tests.reportPath&＃39; property)
INFO: No PHPUnit coverage reports provided (see &＃39;sonar.php.coverage.reportPaths&＃39; property)
INFO: Sensor PHP sensor [php] (done) | time&＃61;387ms
INFO: Sensor Analyzer for "php.ini" files [php]
INFO: Sensor Analyzer for "php.ini" files [php] (done) | time&＃61;2ms
INFO: Sensor Javascript Squid Sensor [Javascript]
INFO: 1 source files to be analyzed
INFO: 1/1 source files have been analyzed
INFO: Unit Test Coverage Sensor is started
INFO: Integration Test Coverage Sensor is started
INFO: Overall Coverage Sensor is started
INFO: Sensor Javascript Squid Sensor [Javascript] (done) | time&＃61;194ms
INFO: Sensor Zero Coverage Sensor
INFO: Sensor Zero Coverage Sensor (done) | time&＃61;23ms
INFO: Sensor CPD Block Indexer
INFO: Sensor CPD Block Indexer (done) | time&＃61;18ms
INFO: No SCM system was detected. You can use the &＃39;sonar.scm.provider&＃39; property to explicitly specify it.
INFO: 7 files had no CPD blocks
INFO: Calculating CPD for 6 files
INFO: CPD calculation finished
INFO: Analysis report generated in 88ms, dir size&＃61;90 KB
INFO: Analysis reports compressed in 25ms, zip size&＃61;42 KB
INFO: Analysis report uploaded in 60ms
INFO: ANALYSIS SUCCESSFUL, you can browse http://localhost:9000/dashboard/index/org.sonarqube:sonarqube-scanner
INFO: Note that you will be able to access the updated dashboard once the server has processed the submitted analysis report
INFO: More about the report processing at http://localhost:9000/api/ce/task?id&＃61;AWVG9oWP0Yruaz76HJQY
INFO: Task total time: 3.756 s
INFO: ------------------------------------------------------------------------
INFO: EXECUTION SUCCESS
INFO: ------------------------------------------------------------------------
INFO: Total time: 4.698s
INFO: Final Memory: 52M/421M
INFO: ------------------------------------------------------------------------
[root&＃64;monitor sonarqube-scanner]# /usr/local/sonar-scanner/bin/sonar-scanner
INFO: Scanner configuration file: /usr/local/sonar-scanner/conf/sonar-scanner.properties
INFO: Project root configuration file: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner/sonar-project.properties
INFO: SonarQube Scanner 2.8
INFO: Java 1.8.0_45 Oracle Corporation (64-bit)
INFO: Linux 2.6.32-573.el6.x86_64 amd64
INFO: User cache: /root/.sonar/cache
INFO: Publish mode
INFO: Load global settings
INFO: Load global settings (done) | time&＃61;63ms
INFO: Server id: A737A953-AWVGKXYQugQwgVmc5Jb0
INFO: User cache: /root/.sonar/cache
INFO: Load plugins index
INFO: Load plugins index (done) | time&＃61;50ms
INFO: Plugin [l10nzh] defines &＃39;l10nen&＃39; as base plugin. This metadata can be removed from manifest of l10n plugins since version 5.2.
INFO: SonarQube server 6.7.5
INFO: Default locale: "en_US", source code encoding: "UTF-8"
INFO: Process project properties
INFO: Load project repositories
INFO: Load project repositories (done) | time&＃61;12ms
INFO: Load quality profiles
INFO: Load quality profiles (done) | time&＃61;29ms
INFO: Load active rules
INFO: Load active rules (done) | time&＃61;446ms
INFO: Load metrics repository
INFO: Load metrics repository (done) | time&＃61;26ms
WARN: SCM provider autodetection failed. No SCM provider claims to support this project. Please use sonar.scm.provider to define SCM of your project.
INFO: Project key: org.sonarqube:sonarqube-scanner
INFO: ------------- Scan Example of SonarQube Scanner Usage
INFO: Load server rules
INFO: Load server rules (done) | time&＃61;42ms
INFO: Base dir: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner
INFO: Working dir: /root/tmp/sonar-scanning-examples-master/sonarqube-scanner/.sonar
INFO: Source paths: src, copybooks
INFO: Source encoding: UTF-8, default locale: en_US
INFO: Index files
INFO: 36 files indexed
INFO: Quality profile for flex: Sonar way
INFO: Quality profile for js: Sonar way
INFO: Quality profile for php: Sonar way
INFO: Quality profile for py: Sonar way
INFO: Quality profile for xml: Sonar way
INFO: Sensor PythonXUnitSensor [python]
INFO: Sensor PythonXUnitSensor [python] (done) | time&＃61;10ms
INFO: Sensor Python Squid Sensor [python]
INFO: Python unit test coverage
INFO: Python integration test coverage
INFO: Python overall test coverage
INFO: Sensor Python Squid Sensor [python] (done) | time&＃61;365ms
INFO: Sensor SonarJavaXmlFileSensor [java]
INFO: 1 source files to be analyzed
INFO: Sensor SonarJavaXmlFileSensor [java] (done) | time&＃61;65ms
INFO: 1/1 source files have been analyzed
INFO: Sensor Flex [flex]
INFO: 2 source files to be analyzed
INFO: 2/2 source files have been analyzed
INFO: Sensor Flex [flex] (done) | time&＃61;98ms
INFO: Sensor Flex Cobertura [flex]
INFO: Analyzing Cobertura report: coverage-report/coverage-cobertua-flex.xml
WARN: Using absolute path pattern is deprecated. Please use relative path instead of &＃39;file:**/Circle.as&＃39;
WARN: Using absolute path pattern is deprecated. Please use relative path instead of &＃39;file:**/UncoveredCircle.as&＃39;
INFO: Sensor Flex Cobertura [flex] (done) | time&＃61;62ms
INFO: Sensor XML Sensor [xml]
INFO: Sensor XML Sensor [xml] (done) | time&＃61;120ms
INFO: Sensor PHP sensor [php]
INFO: 1 source files to be analyzed
INFO: 1/1 source files have been analyzed
INFO: No PHPUnit test report provided (see &＃39;sonar.php.tests.reportPath&＃39; property)
INFO: No PHPUnit coverage reports provided (see &＃39;sonar.php.coverage.reportPaths&＃39; property)
INFO: Sensor PHP sensor [php] (done) | time&＃61;386ms
INFO: Sensor Analyzer for "php.ini" files [php]
INFO: Sensor Analyzer for "php.ini" files [php] (done) | time&＃61;2ms
INFO: Sensor Javascript Squid Sensor [Javascript]
INFO: 1 source files to be analyzed
INFO: 1/1 source files have been analyzed
INFO: Unit Test Coverage Sensor is started
INFO: Integration Test Coverage Sensor is started
INFO: Overall Coverage Sensor is started
INFO: Sensor Javascript Squid Sensor [Javascript] (done) | time&＃61;202ms
INFO: Sensor Zero Coverage Sensor
INFO: Sensor Zero Coverage Sensor (done) | time&＃61;39ms
INFO: Sensor CPD Block Indexer
INFO: Sensor CPD Block Indexer (done) | time&＃61;19ms
INFO: No SCM system was detected. You can use the &＃39;sonar.scm.provider&＃39; property to explicitly specify it.
INFO: 7 files had no CPD blocks
INFO: Calculating CPD for 6 files
INFO: CPD calculation finished
INFO: Analysis report generated in 95ms, dir size&＃61;90 KB
INFO: Analysis reports compressed in 30ms, zip size&＃61;42 KB
INFO: Analysis report uploaded in 148ms
INFO: ANALYSIS SUCCESSFUL, you can browse http://localhost:9000/dashboard/index/org.sonarqube:sonarqube-scanner
INFO: Note that you will be able to access the updated dashboard once the server has processed the submitted analysis report
INFO: More about the report processing at http://localhost:9000/api/ce/task?id&＃61;AWVG93I90Yruaz76HJQm
INFO: Task total time: 3.803 s
INFO: ------------------------------------------------------------------------
INFO: EXECUTION SUCCESS
INFO: ------------------------------------------------------------------------
INFO: Total time: 4.812s
INFO: Final Memory: 53M/416M
INFO: ------------------------------------------------------------------------

4、web查看扫描结果