{"id":96,"date":"2022-04-09T21:12:34","date_gmt":"2022-04-09T13:12:34","guid":{"rendered":"https:\/\/www.qiangzhenshuai.com\/?p=96"},"modified":"2025-01-14T16:57:16","modified_gmt":"2025-01-14T08:57:16","slug":"linux-awk%e5%8f%96%e5%88%97","status":"publish","type":"post","link":"https:\/\/www.qiangzhenshuai.com\/?p=96","title":{"rendered":"Linux-awk\u53d6\u5217"},"content":{"rendered":"<h1>1.awk\u6982\u8ff0<\/h1>\n<p>\u5b9a\u4e49\uff1aAWK \u662f\u4e00\u79cd\u89e3\u91ca\u578b\u8bed\u8a00\uff0c\u5b83\u9010\u884c\u8bfb\u53d6\u6587\u672c\u8f93\u5165\uff0c\u6839\u636e\u6307\u5b9a\u7684\u6a21\u5f0f\u5bf9\u6bcf\u4e00\u884c\u8fdb\u884c\u5339\u914d\uff0c\u5e76\u6267\u884c\u76f8\u5e94\u7684\u52a8\u4f5c\u3002AWK \u7a0b\u5e8f\u901a\u5e38\u7531\u4e00\u7cfb\u5217\u6a21\u5f0f &#8211; \u52a8\u4f5c\u5bf9\u7ec4\u6210\u3002<\/p>\n<p>\u5de5\u4f5c\u6d41\u7a0b\uff1aAWK \u4ece\u8f93\u5165\u6587\u4ef6\uff08\u6216\u6807\u51c6\u8f93\u5165\uff09\u4e2d\u8bfb\u53d6\u4e00\u884c\u6570\u636e\uff0c\u7136\u540e\u5c06\u8be5\u884c\u6570\u636e\u4e0e\u7a0b\u5e8f\u4e2d\u5b9a\u4e49\u7684\u5404\u4e2a\u6a21\u5f0f\u8fdb\u884c\u5339\u914d\u3002\u5982\u679c\u67d0\u4e00\u884c\u5339\u914d\u67d0\u4e2a\u6a21\u5f0f\uff0c\u5c31\u6267\u884c\u4e0e\u8be5\u6a21\u5f0f\u5173\u8054\u7684\u52a8\u4f5c\u3002\u52a8\u4f5c\u53ef\u4ee5\u662f\u6253\u5370\u8be5\u884c\u7684\u7279\u5b9a\u5b57\u6bb5\u3001\u8fdb\u884c\u8ba1\u7b97\u3001\u751f\u6210\u65b0\u7684\u8f93\u51fa\u7b49\u3002\u5904\u7406\u5b8c\u4e00\u884c\u540e\uff0cAWK \u8bfb\u53d6\u4e0b\u4e00\u884c\uff0c\u91cd\u590d\u8fd9\u4e2a\u8fc7\u7a0b\uff0c\u76f4\u5230\u8f93\u5165\u7ed3\u675f<\/p>\n<h1>2.awk \u6587\u672c\u5904\u7406\u5de5\u5177<\/h1>\n<pre>-F: \u6307\u5b9a\u5b57\u6bb5\u5206\u9694\u7b26\r\n-v\uff1a\u8fdb\u5165\u53d8\u91cf\u6a21\u5f0f \u53ef\u4ee5\u8fdb\u884c\u53d8\u91cf\u7684\u8d4b\u503c\u53ca\u8c03\u7528\uff08\u8c03\u7528\u4e0d\u9700\u8981\u52a0$\u7b26\uff09\r\nNR\uff1a\u6307\u5b9a\u83b7\u53d6\u591a\u5c11\u884c\r\n$\u6570\u5b57\uff1a\u67d0\u4e00\u5217\r\n$NF\uff1a\u6700\u540e\u4e00\u5217\r\n$(NF - 1)\u00a0\u5219\u8868\u793a\u5f53\u524d\u884c\u5012\u6570\u7b2c\u4e8c\u4e2a\u5b57\u6bb5\r\n$1~$n\uff1a\u7b2c\u51e0\u5217\r\n$0\uff1a\u8868\u793a\u6574\u4e2a\u8f93\u5165\u884c\u3002\r\n-d[file]\uff1a\u542f\u7528\u8c03\u8bd5\u6a21\u5f0f\u3002\u5982\u679c\u6307\u5b9a\u4e86file\uff0c\u5219\u5c06\u8c03\u8bd5\u4fe1\u606f\u8f93\u51fa\u5230\u8be5\u6587\u4ef6\u4e2d\uff1b\u5426\u5219\u8f93\u51fa\u5230\u6807\u51c6\u9519\u8bef\u8f93\u51fa\u3002\u8fd9\u6709\u52a9\u4e8e\u4e86\u89e3 AWK \u811a\u672c\u7684\u6267\u884c\u8fc7\u7a0b\r\n-f\u00a0\u9009\u9879\u662f\u00a0awk\u00a0\u547d\u4ee4\u4e2d\u7528\u4e8e\u6307\u5b9a\u811a\u672c\u6587\u4ef6\u7684\u53c2\u6570\r\n$n\uff1a\u8868\u793a\u7b2cn\u4e2a\u5b57\u6bb5\u3002\r\n--posix\uff1a\u4f7f AWK \u9075\u5faa POSIX \u6807\u51c6\uff0c\u786e\u4fdd AWK \u7684\u884c\u4e3a\u5728\u4e0d\u540c\u7cfb\u7edf\u4e0a\u5177\u6709\u4e00\u81f4\u6027\uff0c\u5c24\u5176\u662f\u5728\u5904\u7406\u4e00\u4e9b\u8fb9\u754c\u60c5\u51b5\u548c\u7279\u6b8a\u529f\u80fd\u65f6\r\n--lint\uff1a\u542f\u7528 lint \u6a21\u5f0f\uff0c\u68c0\u67e5 AWK \u811a\u672c\u4e2d\u7684\u6f5c\u5728\u95ee\u9898\u548c\u4e0d\u89c4\u8303\u7528\u6cd5\u3002\u5b83\u4f1a\u5728\u811a\u672c\u6267\u884c\u524d\u8f93\u51fa\u4e00\u4e9b\u8b66\u544a\u4fe1\u606f\uff0c\u63d0\u793a\u53ef\u80fd\u5b58\u5728\u7684\u95ee\u9898\r\n&amp;&amp; \u5e76\u4e14 \u540c\u65f6\u6210\u7acb\r\n|| \u6216\u8005\r\nprint \u662f awk \u4e2d\u7528\u4e8e\u8f93\u51fa\u6570\u636e\u7684\u57fa\u672c\u547d\u4ee4\r\n$\uff1a\u7528\u4e8e\u5f15\u7528\u5b57\u6bb5\u3002\u4f8b\u5982\uff0c$1\u00a0\u8868\u793a\u7b2c\u4e00\u5b57\u6bb5\uff0c$2\u00a0\u8868\u793a\u7b2c\u4e8c\u5b57\u6bb5\uff0c$0\u00a0\u8868\u793a\u6574\u4e2a\u5f53\u524d\u8bb0\u5f55\u884c\u3002\r\nFS\uff1a\u5185\u7f6e\u53d8\u91cf\uff0c\u7528\u4e8e\u8bbe\u7f6e\u5b57\u6bb5\u5206\u9694\u7b26\uff0c\u9ed8\u8ba4\u662f\u7a7a\u683c\u6216\u5236\u8868\u7b26\u3002\u53ef\u4ee5\u901a\u8fc7\u00a0-F\u00a0\u9009\u9879\u5728\u547d\u4ee4\u884c\u8bbe\u7f6e\uff0c\u4e5f\u53ef\u4ee5\u5728\u811a\u672c\u4e2d\u4fee\u6539\u3002\u4f8b\u5982\uff0cawk -F, '{print $1}' file.csv\u00a0\u4f7f\u7528\u9017\u53f7\u4f5c\u4e3a\u5b57\u6bb5\u5206\u9694\u7b26\u6765\u6253\u5370\u00a0file.csv\u00a0\u7684\u7b2c\u4e00\u5b57\u6bb5\u3002\r\nRS\uff1a\u5185\u7f6e\u53d8\u91cf\uff0c\u7528\u4e8e\u8bbe\u7f6e\u8bb0\u5f55\u5206\u9694\u7b26\uff0c\u9ed8\u8ba4\u662f\u6362\u884c\u7b26\u3002\u4f8b\u5982\uff0cawk -v RS=, '{print NR,$0}' \u628a\u9017\u53f7\u8bbe\u7f6e\u4e3a\u8bb0\u5f55\u5206\u9694\u7b26\r\n%s\uff1a\u5b57\u7b26\u4e32\u683c\u5f0f\u3002\r\n%d\uff1a\u5341\u8fdb\u5236\u6574\u6570\u683c\u5f0f\u3002\r\n%f\uff1a\u6d6e\u70b9\u6570\u683c\u5f0f\r\n;\uff1a\u8bed\u53e5\u5206\u9694\u7b26\uff0c\u7528\u4e8e\u5728\u540c\u4e00\u884c\u4e0a\u4e66\u5199\u591a\u4e2a\u8bed\u53e5\r\n[ :]+\u00a0\u662f\u4e00\u4e2a\u6b63\u5219\u8868\u8fbe\u5f0f\uff0c\u8868\u793a\u5339\u914d\u4e00\u4e2a\u6216\u591a\u4e2a\u7a7a\u683c\u6216\u8005\u5192\u53f7\u3002\u8fd9\u610f\u5473\u7740\u00a0awk\u00a0\u5c06\u6839\u636e\u4e00\u4e2a\u6216\u591a\u4e2a\u7a7a\u683c\u6216\u8005\u5192\u53f7\u6765\u5206\u5272\u8f93\u5165\u884c\u7684\u5b57\u6bb5\r\n{}\uff1a\u52a8\u4f5c\u5757\uff0c\u5305\u542b\u5f53\u6761\u4ef6\u6ee1\u8db3\u65f6\u8981\u6267\u884c\u7684\u4e00\u7cfb\u5217\u547d\u4ee4\r\n~ \u548c !~\uff1a~ \u8868\u793a\u5339\u914d\u6b63\u5219\u8868\u8fbe\u5f0f\uff0c!~ \u8868\u793a\u4e0d\u5339\u914d\u6b63\u5219\u8868\u8fbe\u5f0f\u3002\u4f8b\u5982\uff0cawk '$1 ~ \/^[0-9]+$\/' file.txt \u4f1a\u6253\u5370 file.txt \u4e2d\u7b2c\u4e00\u5b57\u6bb5\u5168\u662f\u6570\u5b57\u7684\u884c\r\nOFS\uff1a\u6307\u5b9a\u8f93\u51fa\u5b57\u6bb5\u5206\u9694\u7b26\uff0c\u9ed8\u8ba4\u4e3a\u7a7a\u683c\u3002\r\n^\uff1a\u5728\u6b63\u5219\u8868\u8fbe\u5f0f\u4e2d\uff0c^ \u8868\u793a\u884c\u7684\u5f00\u5934\r\n$\uff1a\u5728\u6b63\u5219\u8868\u8fbe\u5f0f\u4e2d\uff0c$\u00a0\u8868\u793a\u884c\u7684\u7ed3\u5c3e<\/pre>\n<h4>\u663e\u793a\u5e26root\u7684\u884c<\/h4>\n<pre>awk '\/root\/' \/etc\/passwd<\/pre>\n<h4>\u663e\u793a\u7b2c10\u884c\u5230\u7b2c14\u884c\u7684\u7b2c3\u5217<\/h4>\n<pre>awk -F: '{if(NR&gt;=10 &amp;&amp; NR&lt;=14) print $3 }' \/etc\/passwd<\/pre>\n<h4>\u7b2c\u4e00\u5217\u548c\u7b2c\u4e09\u5217<\/h4>\n<pre>[root@shell ~]$ awk -F: '{print $1,$3}' \/etc\/passwd<\/pre>\n<h4>\u663e\u793a\u7b2c1\u5217\u548c\u7b2c3\u5217\u548c\u6700\u540e\u4e00\u5217\u4f7f\u7528\u5206\u9694\u7b26<\/h4>\n<pre>[root@shell ~]$ awk -F: -vOFS=# '{print $1,$3,$NF}' \/etc\/passwd\r\nawk -F: -vOFS='#####' '{print $1,$3,$NF}'<\/pre>\n<h4>\u663e\u793a\u884c\u6570<\/h4>\n<pre>awk 'END { print NR;}' \/etc\/passwd<\/pre>\n<h4>\u67e5\u627enginx\u7684\u8fdb\u7a0bid<\/h4>\n<pre>ps aux|grep nginx|grep -v grep|awk '{print $2}'<\/pre>\n<h4>\u4f7f\u7528&#8221;\uff1a&#8221;\u5206\u5272\uff0c\u663e\u793a\u6587\u4ef6\u7b2c1\u5217<\/h4>\n<pre>awk -F ':' '{print $1}' \/etc\/passwd<\/pre>\n<h4>\u4f7f\u7528&#8221;\uff1a&#8221;\u5206\u5272\uff0c\u663e\u793a\u6587\u4ef6\u7b2c1\uff0c2\uff0c3\u5217<\/h4>\n<pre>awk -F ':' '{print $1, $2, $3}' \/etc\/passwd<\/pre>\n<h4>\u4f7f\u7528-v\u8bbe\u7f6e\u53d8\u91cf\uff0c1+a\uff1a\u5728\u7b2c1\u5217\u540e\u9762\u6dfb\u52a0a\u5217<\/h4>\n<pre>awk -F ':' -va='666' '{print $1, $1+a}' \/etc\/passwd<\/pre>\n<h4>\u4f7f\u7528-v\u8bbe\u7f6e\u53d8\u91cf\uff0c1b\uff1a\u5728\u7b2c1\u5217\u540e\u9762\u62fc\u63a5b\u503c\u4f5c\u4e3a\u65b0\u76841\u5217<\/h4>\n<pre>awk -F ':' -va='666' -vb='abc' '{print $1, $1+a, $1b}' \/etc\/passwd<\/pre>\n<h4>\u7edf\u8ba1\u65e5\u5fd7\u51fa\u73b0ip\u6b21\u6570<\/h4>\n<pre>awk '{print $1}' access.log | sort | uniq -c | sort -nr | head<\/pre>\n<h4>\u7edf\u8ba1\u65e5\u5fd7\u51fa\u73b0\u72b6\u6001\u7801\u6b21\u6570<\/h4>\n<pre>awk '{print $9}' access.log | sort | uniq -c | sort -nr | head<\/pre>\n<h4>\u53d6\u51fatop \u547d\u4ee4\u4e2d\u8fd0\u884c\u65f6\u95f4<\/h4>\n<pre>[root@shell ~]$ top -n1 |awk -F'[ ,]+' 'NR==1{print $5}'<\/pre>\n<h4>\u7edf\u8ba1access.log\u4e2d \u72b6\u6001\u7801\u662f200\u7684\u6b21\u6570,\u53ca\u72b6\u6001\u7801\u4e3a200\u7684\u6d41\u91cf\u603b\u548c<\/h4>\n<pre>[root@shell ~]$ awk '$9==200{i++ ; sum=sum+$10}END{print \"200\u6b21\u6570:\"i,\"200\u6d41\u91cf\u603b\u548c:\"sum}' access.log \r\n200\u6b21\u6570:199 200\u6d41\u91cf\u603b\u548c:120564<\/pre>\n<h4>\u53d6\u51fa\u7f51\u5361\u914d\u7f6e\u6587\u4ef6\u4e2d\u7684ip\u90e8\u5206<\/h4>\n<pre>[root@shell ~]$ awk '\/IPADDR\/{print }' \/etc\/sysconfig\/network-scripts\/ifcfg-eth0<\/pre>\n<h4 class=\"header-vfC6AV auto-hide-last-sibling-br\">\u8c03\u8bd5\u53c2\u6570<\/h4>\n<div>\n<div dir=\"ltr\">\n<pre>awk -d debug.log -f myscript.awk input.txt #\u8c03\u8bd5\u4fe1\u606f\u5c06\u88ab\u8bb0\u5f55\u5230debug.log\u6587\u4ef6\u4e2d<\/pre>\n<h4 class=\"header-vfC6AV auto-hide-last-sibling-br\">\u5176\u4ed6\u53c2\u6570<\/h4>\n<pre>awk --lint -f myscript.awk<\/pre>\n<pre>awk --posix '{print $0}' input.txt<\/pre>\n<h4>\u5206\u522b\u7edf\u8ba1\u6bcf\u79cd\u72b6\u6001\u7801\u7684\u6b21\u6570\u53ca\u6d41\u91cf\u603b\u548c<\/h4>\n<pre>[root@shell ~]$ awk '\r\n$9~\/^2\/{ i2++; sum2+=$10 }\r\n$9~\/^3\/{ i3++; sum3+=$10 }\r\n$9~\/^4\/{ i4++; sum4+=$10 }\r\n$9~\/^5\/{ i5++; sum5+=$10 }\r\nEND{\r\nprint \"2xx:\",i2,sum2;\r\nprint \"3xx:\",i3,sum3;\r\nprint \"4xx:\",i4,sum4;\r\nprint \"5xx:\",i5,sum5;\r\n}' access.log|column -t\r\n\r\n2xx: 199 120564\r\n3xx: 84 0\r\n4xx: 646 315252\r\n5xx:<\/pre>\n<h2>\u7279\u6b8a\u7b26\u53f7<\/h2>\n<p>[root@shell ~]$ cat awk.txt<br \/>\n1 a<br \/>\n2 c<br \/>\n3 d<br \/>\n4 f<br \/>\n5 s<br \/>\n6 z<br \/>\n7 k<br \/>\n8 l<br \/>\n9 m<br \/>\n10 b<\/p>\n<h4>\u5339\u914d\u7b2c\u4e00\u884c<\/h4>\n<p>[root@shell ~]$ awk &#8216;NR==1&#8217; awk.txt<br \/>\n1 a<\/p>\n<h4>\u5339\u914d\u5927\u4e8e\u6216\u7b49\u4e8e3\u7684\u884c<\/h4>\n<p>[root@shell ~]$ awk &#8216;NR&gt;=3&#8217; awk.txt<br \/>\n3 d<br \/>\n4 f<br \/>\n5 s<br \/>\n6 z<br \/>\n7 k<br \/>\n8 l<br \/>\n9 m<br \/>\n10 b<\/p>\n<h4>\u5339\u914d\u7b2c3\u884c\u5230\u7b2c5\u884c<\/h4>\n<p>[root@shell ~]$ awk &#8216;NR&gt;=3 &amp;&amp; NR&lt;=5&#8217; awk.txt<br \/>\n3 d<br \/>\n4 f<br \/>\n5 s<\/p>\n<h3>!=\u00a0(\u4e0d\u7b49\u4e8e)<\/h3>\n<h4 data-spm-anchor-id=\"5176.28103460.0.i23.5e045d27tGUXWv\">\u6240\u6709\u7b2c\u4e00\u5217\u4e0d\u662f 1 \u7684\u884c<\/h4>\n<div class=\"tongyi-design-highlighter global-dark-theme\">[root@shell ~]$ awk &#8216;$1 != 1&#8217; awk.txt<br \/>\n2 c<br \/>\n3 d<br \/>\n4 f<br \/>\n5 s<br \/>\n6 z<br \/>\n7 k<br \/>\n8 l<br \/>\n9 m<br \/>\n10 b<\/div>\n<h4 data-spm-anchor-id=\"5176.28103460.0.i25.5e045d27tGUXWv\">\u6240\u6709\u7b2c\u4e8c\u5217\u4e0d\u662f &#8220;a&#8221; \u7684\u884c<\/h4>\n<p>[root@shell ~]$ awk &#8216;$2 != &#8220;a&#8221;&#8216; awk.txt<br \/>\n2 c<br \/>\n3 d<br \/>\n4 f<br \/>\n5 s<br \/>\n6 z<br \/>\n7 k<br \/>\n8 l<br \/>\n9 m<br \/>\n10 b<\/p>\n<h4 data-spm-anchor-id=\"5176.28103460.0.i30.5e045d27tGUXWv\">\u7b2c\u4e00\u5217\u6570\u503c\u5927\u4e8e 5 \u4e14\u7b2c\u4e8c\u5217\u4e0d\u662f &#8220;s&#8221; \u7684\u884c<\/h4>\n<\/div>\n<\/div>\n<div>[root@shell ~]$ awk &#8216;NR&gt;5 &amp;&amp; $2 != &#8220;s&#8221;&#8216; awk.txt<br \/>\n6 z<br \/>\n7 k<br \/>\n8 l<br \/>\n9 m<br \/>\n10 b<\/div>\n<h4>\u7b2c1\u884c\u548c\u6240\u6709\u4ece\u7b2c3\u884c\u5f00\u59cb\u5230\u7b2c5\u884c\u4e4b\u95f4\uff08\u5305\u62ec\u7b2c3\u548c\u7b2c5\u884c\uff09\uff0c\u5e76\u4e14\u7b2c\u4e8c\u5217\u4e0d\u662f &#8220;d&#8221; \u7684\u6240\u6709\u884c<\/h4>\n<p>[root@shell ~]$ awk &#8216;NR==1 || (NR&gt;=3 &amp;&amp; NR&lt;=5 &amp;&amp; $2 != &#8220;d&#8221;)&#8217; awk.txt<br \/>\n1 a<br \/>\n4 f<br \/>\n5 s<\/p>\n<h4>\u591a\u79cd\u4f7f\u7528<\/h4>\n<p>[root@shell ~]$ awk &#8216;NR==1 { print &#8220;First line: &#8221; $0 }NR&gt;=3 &amp;&amp; NR&lt;=5 &amp;&amp; $2 != &#8220;d&#8221; { print &#8220;Line between 3 and 5, second column not 10: &#8221; $0 }&#8217; awk.txt<\/p>\n<p>First line: 1 a<br \/>\nLine between 3 and 5, second column not 10: 4 f<br \/>\nLine between 3 and 5, second column not 10: 5 s<\/p>\n<p>1.NR==1 { print &#8220;First line: &#8221; $0 }<\/p>\n<p>\u6a21\u5f0f\uff1aNR==1\u00a0\u8868\u793a\u5f53\u524d\u884c\u662f\u6587\u4ef6\u7684\u7b2c\u4e00\u884c\uff08\u8bb0\u5f55\u53f7\u00a0NR\u00a0\u7b49\u4e8e1\uff09\u3002<br \/>\n\u52a8\u4f5c\uff1a{ print &#8220;First line: &#8221; $0 }\u00a0\u5f53\u6761\u4ef6\u4e3a\u771f\u65f6\uff0c\u6253\u5370\u6574\u884c\u5185\u5bb9\uff0c\u5e76\u5728\u5176\u524d\u9762\u52a0\u4e0a\u00a0&#8220;First line: &#8221;\u00a0\u5b57\u7b26\u4e32\u3002<br \/>\n\u4f5c\u7528\uff1a\u5982\u679c\u5f53\u524d\u5904\u7406\u7684\u662f\u6587\u4ef6\u7684\u7b2c\u4e00\u884c\uff0c\u5219\u8f93\u51fa\u8be5\u884c\u7684\u5185\u5bb9\uff0c\u5e76\u6807\u6ce8\u4e3a\u7b2c\u4e00\u884c\u3002<\/p>\n<p>2.NR&gt;=3 &amp;&amp; NR&lt;=5 &amp;&amp; $2 != &#8220;d&#8221; { print &#8220;Line between 3 and 5, second column not d: &#8221; $0 }<br \/>\n\u6a21\u5f0f\uff1aNR&gt;=3 &amp;&amp; NR&lt;=5 &amp;&amp; $2 != &#8220;d&#8221;\u00a0\u8868\u793a\u5f53\u524d\u884c\u53f7\u57283\u52305\u4e4b\u95f4\uff08\u5305\u62ec3\u548c5\uff09\uff0c\u5e76\u4e14\u7b2c\u4e8c\u5217\u7684\u503c\u4e0d\u7b49\u4e8e\u5b57\u7b26\u4e32\u00a0&#8220;d&#8221;\u3002<br \/>\n\u52a8\u4f5c\uff1a{ print &#8220;Line between 3 and 5, second column not d: &#8221; $0 }\u00a0\u5f53\u6240\u6709\u6761\u4ef6\u90fd\u6ee1\u8db3\u65f6\uff0c\u6253\u5370\u6574\u884c\u5185\u5bb9\uff0c\u5e76\u5728\u5176\u524d\u9762\u52a0\u4e0a\u00a0&#8220;Line between 3 and 5, second column not d: &#8221;\u00a0\u5b57\u7b26\u4e32\u3002<br \/>\n\u4f5c\u7528\uff1a\u5982\u679c\u5f53\u524d\u884c\u5728\u7b2c3\u5230\u7b2c5\u884c\u4e4b\u95f4\uff0c\u4e14\u7b2c\u4e8c\u5217\u4e0d\u662f\u00a0&#8220;d&#8221;\uff0c\u5219\u8f93\u51fa\u8be5\u884c\u7684\u5185\u5bb9\uff0c\u5e76\u6dfb\u52a0\u63cf\u8ff0\u6027\u524d\u7f00\u3002<\/p>\n<h1>3.BEGIN<\/h1>\n<p>BEGIN \u662f awk \u4e2d\u7684\u4e00\u4e2a\u7279\u6b8a\u6a21\u5f0f\uff0c\u5b83\u5728\u5904\u7406\u4efb\u4f55\u8f93\u5165\u4e4b\u524d\u6267\u884c\u3002\u8fd9\u610f\u5473\u7740\uff0c\u5728\u8bfb\u53d6\u548c\u5904\u7406\u6587\u4ef6\u5185\u5bb9\u4e4b\u524d\uff0cBEGIN \u5757\u4e2d\u7684\u4ee3\u7801\u4f1a\u9996\u5148\u88ab\u6267\u884c\u3002\u8fd9\u4e2a\u7279\u6027\u4f7f\u5f97 BEGIN \u975e\u5e38\u9002\u5408\u7528\u4e8e\u521d\u59cb\u5316\u53d8\u91cf\u3001\u8bbe\u7f6e\u73af\u5883\uff08\u5982\u5b57\u6bb5\u5206\u9694\u7b26\uff09\u3001\u6253\u5370\u6807\u9898\u6216\u5176\u4ed6\u9884\u5904\u7406\u4efb\u52a1<\/p>\n<h2 data-spm-anchor-id=\"5176.28103460.0.i70.5e045d27tGUXWv\">BEGIN \u7684\u57fa\u672c\u6982\u8ff0<\/h2>\n<p>\u5b9a\u4e49\uff1aBEGIN\u00a0\u662f\u4e00\u4e2a\u5173\u952e\u5b57\uff0c\u7528\u6765\u6807\u8bc6\u4e00\u4e2a\u7279\u6b8a\u7684\u4ee3\u7801\u5757\uff0c\u8be5\u4ee3\u7801\u5757\u5728\u00a0awk\u00a0\u5f00\u59cb\u5904\u7406\u8f93\u5165\u6570\u636e\u4e4b\u524d\u8fd0\u884c\u3002<\/p>\n<p>\u8bed\u6cd5\uff1aBEGIN { &#8230; }<\/p>\n<p>\u4f5c\u7528\uff1a\u901a\u5e38\u7528\u4e8e\u521d\u59cb\u5316\u64cd\u4f5c\u6216\u8bbe\u7f6e\u5168\u5c40\u53c2\u6570\uff0c\u786e\u4fdd\u8fd9\u4e9b\u8bbe\u7f6e\u5728\u5904\u7406\u5b9e\u9645\u6570\u636e\u4e4b\u524d\u5df2\u7ecf\u5b8c\u6210<\/p>\n<h4 data-spm-anchor-id=\"5176.28103460.0.i72.5e045d27tGUXWv\">\u8bbe\u7f6e\u8f93\u5165\/\u8f93\u51fa\u683c\u5f0f<\/h4>\n<pre data-spm-anchor-id=\"5176.28103460.0.i74.5e045d27tGUXWv\">BEGIN {\r\n    FS = \",\"          # \u8bbe\u7f6e\u8f93\u5165\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u9017\u53f7\r\n    OFS = \"\\t\"        # \u8bbe\u7f6e\u8f93\u51fa\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u5236\u8868\u7b26\r\n    ORS = \"\\n\\n\"      # \u8bbe\u7f6e\u8f93\u51fa\u8bb0\u5f55\u5206\u9694\u7b26\u4e3a\u53cc\u6362\u884c\r\n}<\/pre>\n<h4>\u4f7f\u7528<\/h4>\n<p>[root@shell ~]$ cat cj.txt<br \/>\nAlice,23,85<br \/>\nBob,22,92<br \/>\nCharlie,24,78<br \/>\nDavid,21,88<\/p>\n<p>[root@shell ~]$ awk &#8216;<br \/>\n&gt; BEGIN {<br \/>\n&gt; FS = &#8220;,&#8221; # \u8bbe\u7f6e\u8f93\u5165\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u9017\u53f7<br \/>\n&gt; OFS = &#8220;\\t&#8221; # \u8bbe\u7f6e\u8f93\u51fa\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u5236\u8868\u7b26<br \/>\n&gt; print &#8220;Name&#8221;, &#8220;Age&#8221;, &#8220;Score&#8221; # \u6253\u5370\u6807\u9898<br \/>\n&gt; }<br \/>\n&gt;<br \/>\n&gt; {<br \/>\n&gt; sum += $3 # \u7d2f\u52a0\u5206\u6570<br \/>\n&gt; count++ # \u8ba1\u6570\u5b66\u751f\u6570\u91cf<br \/>\n&gt; print $1, $2, $3 # \u6253\u5370\u6bcf\u4e00\u884c\u7684\u5b66\u751f\u4fe1\u606f<br \/>\n&gt; }<br \/>\n&gt;<br \/>\n&gt; END {<br \/>\n&gt; avg = sum \/ count # \u8ba1\u7b97\u5e73\u5747\u5206<br \/>\n&gt; print &#8220;Average Score:&#8221;, avg # \u6253\u5370\u5e73\u5747\u5206<br \/>\n&gt; }&#8217; cj.txt<\/p>\n<p>Name Age Score<br \/>\nAlice 23 85<br \/>\nBob 22 92<br \/>\nCharlie 24 78<br \/>\nDavid 21 88<br \/>\nAverage Score: 85.75<\/p>\n<h4>\u811a\u672c<\/h4>\n<p>[root@shell ~]$ cat awk.sh<br \/>\nawk &#8216;<br \/>\nBEGIN {<br \/>\nFS = &#8220;,&#8221; # \u8bbe\u7f6e\u8f93\u5165\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u9017\u53f7<br \/>\nOFS = &#8220;\\t&#8221; # \u8bbe\u7f6e\u8f93\u51fa\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u5236\u8868\u7b26<br \/>\nprint &#8220;Name&#8221;, &#8220;Age&#8221;, &#8220;Score&#8221; # \u6253\u5370\u6807\u9898<br \/>\n}<\/p>\n<p>{<br \/>\nsum += $3 # \u7d2f\u52a0\u5206\u6570<br \/>\ncount++ # \u8ba1\u6570\u5b66\u751f\u6570\u91cf<br \/>\nprint $1, $2, $3 # \u6253\u5370\u6bcf\u4e00\u884c\u7684\u5b66\u751f\u4fe1\u606f<br \/>\n}<\/p>\n<p>END {<br \/>\navg = sum \/ count # \u8ba1\u7b97\u5e73\u5747\u5206<br \/>\nprint &#8220;Average Score:&#8221;, avg # \u6253\u5370\u5e73\u5747\u5206<br \/>\n}&#8217; cj.txt<\/p>\n<p>[root@shell ~]$ sh awk.sh<br \/>\nName Age Score<br \/>\nAlice 23 85<br \/>\nBob 22 92<br \/>\nCharlie 24 78<br \/>\nDavid 21 88<br \/>\nAverage Score: 85.75<\/p>\n<h3>\u6ce8\u610f\u4e8b\u9879<\/h3>\n<p>BEGIN\u00a0\u5757\u4ec5\u5728\u00a0awk\u00a0\u5f00\u59cb\u5904\u7406\u8f93\u5165\u4e4b\u524d\u6267\u884c\u4e00\u6b21\u3002<\/p>\n<p>\u5982\u679c\u6ca1\u6709\u5176\u4ed6\u6a21\u5f0f\u6216\u52a8\u4f5c\u5757\uff0c\u53ea\u6709\u00a0BEGIN\u00a0\u548c\u00a0END\u00a0\u5757\u5b58\u5728\u65f6\uff0cawk\u00a0\u4e0d\u4f1a\u8bfb\u53d6\u4efb\u4f55\u8f93\u5165\u6587\u4ef6\u3002<\/p>\n<p>BEGIN\u00a0\u53ef\u4ee5\u4e0e\u5176\u4ed6\u6a21\u5f0f\/\u52a8\u4f5c\u5bf9\u7ed3\u5408\u4f7f\u7528\uff0c\u4f46\u5b83\u7684\u4ee3\u7801\u603b\u662f\u6700\u5148\u6267\u884c<\/p>\n<h1>4.END<\/h1>\n<p>END \u662f awk \u4e2d\u7684\u4e00\u4e2a\u7279\u6b8a\u6a21\u5f0f\uff0c\u5b83\u5728\u6240\u6709\u8f93\u5165\u6570\u636e\u5904\u7406\u5b8c\u6bd5\u540e\u6267\u884c\u3002\u8fd9\u610f\u5473\u7740\uff0c\u5728 awk \u8bfb\u53d6\u5e76\u5904\u7406\u5b8c\u6240\u6709\u7684\u8f93\u5165\u884c\u4e4b\u540e\uff0cEND \u5757\u4e2d\u7684\u4ee3\u7801\u4f1a\u88ab\u6267\u884c\u3002\u8fd9\u4f7f\u5f97 END \u975e\u5e38\u9002\u5408\u7528\u4e8e\u603b\u7ed3\u6027\u64cd\u4f5c\u3001\u8f93\u51fa\u7edf\u8ba1\u4fe1\u606f\u6216\u6e05\u7406\u8d44\u6e90\u3002<\/p>\n<h2>END \u7684\u57fa\u672c\u6982\u8ff0<\/h2>\n<p>\u5b9a\u4e49\uff1aEND\u00a0\u662f\u4e00\u4e2a\u5173\u952e\u5b57\uff0c\u7528\u6765\u6807\u8bc6\u4e00\u4e2a\u7279\u6b8a\u7684\u4ee3\u7801\u5757\uff0c\u8be5\u4ee3\u7801\u5757\u5728\u00a0awk\u00a0\u5b8c\u6210\u6240\u6709\u8f93\u5165\u6570\u636e\u7684\u5904\u7406\u540e\u8fd0\u884c\u3002<\/p>\n<p>\u8bed\u6cd5\uff1aEND { &#8230; }<\/p>\n<p>\u4f5c\u7528\uff1a\u901a\u5e38\u7528\u4e8e\u5728\u5904\u7406\u5b8c\u6240\u6709\u6570\u636e\u540e\u8fdb\u884c\u603b\u7ed3\u3001\u8f93\u51fa\u7edf\u8ba1\u7ed3\u679c\u3001\u5173\u95ed\u6587\u4ef6\u6216\u5176\u4ed6\u6e05\u7406\u5de5\u4f5c<\/p>\n<p>[root@shell ~]$ cat cj1.sh<br \/>\nawk &#8216;<br \/>\nBEGIN {<br \/>\nFS = &#8220;,&#8221; # \u8bbe\u7f6e\u8f93\u5165\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u9017\u53f7<br \/>\nOFS = &#8220;\\t&#8221; # \u8bbe\u7f6e\u8f93\u51fa\u5b57\u6bb5\u5206\u9694\u7b26\u4e3a\u5236\u8868\u7b26<br \/>\nprint &#8220;Name&#8221;, &#8220;Age&#8221;, &#8220;Score&#8221; # \u6253\u5370\u6807\u9898<br \/>\n}<\/p>\n<p>{<br \/>\nsum += $3 # \u7d2f\u52a0\u5206\u6570<br \/>\ncount++ # \u8ba1\u6570\u5b66\u751f\u6570\u91cf<br \/>\nprint $1, $2, $3 # \u6253\u5370\u6bcf\u4e00\u884c\u7684\u5b66\u751f\u4fe1\u606f<br \/>\n}<\/p>\n<p>END {<br \/>\nif (count &gt; 0) {<br \/>\navg = sum \/ count # \u8ba1\u7b97\u5e73\u5747\u5206<br \/>\nprint &#8220;Average Score:&#8221;, avg # \u6253\u5370\u5e73\u5747\u5206<br \/>\n}<br \/>\n}&#8217; cj.txt<\/p>\n<p>[root@shell ~]$ sh cj1.sh<br \/>\nName Age Score<br \/>\nAlice 23 85<br \/>\nBob 22 92<br \/>\nCharlie 24 78<br \/>\nDavid 21 88<br \/>\nAverage Score: 85.75<\/p>\n<h3>\u6ce8\u610f\u4e8b\u9879<\/h3>\n<p>END\u00a0\u5757\u4ec5\u5728\u00a0awk\u00a0\u5904\u7406\u5b8c\u6240\u6709\u8f93\u5165\u540e\u6267\u884c\u4e00\u6b21\u3002<\/p>\n<p>\u5982\u679c\u6ca1\u6709\u5176\u4ed6\u6a21\u5f0f\u6216\u52a8\u4f5c\u5757\uff0c\u53ea\u6709\u00a0BEGIN\u00a0\u548c\u00a0END\u00a0\u5757\u5b58\u5728\u65f6\uff0cawk\u00a0\u4e0d\u4f1a\u8bfb\u53d6\u4efb\u4f55\u8f93\u5165\u6587\u4ef6\u3002<\/p>\n<p>END\u00a0\u53ef\u4ee5\u4e0e\u5176\u4ed6\u6a21\u5f0f\/\u52a8\u4f5c\u5bf9\u7ed3\u5408\u4f7f\u7528\uff0c\u4f46\u5b83\u7684\u4ee3\u7801\u603b\u662f\u6700\u540e\u6267\u884c\u3002<\/p>\n<h1>5.awk\u6570\u7ec4<\/h1>\n<p>awk \u4e2d\u7684\u6570\u7ec4\u662f\u5173\u8054\u6570\u7ec4\uff08\u4e5f\u79f0\u4e3a\u54c8\u5e0c\u8868\u6216\u5b57\u5178\uff09\uff0c\u8fd9\u610f\u5473\u7740\u5b83\u4eec\u4e0d\u662f\u901a\u8fc7\u6570\u5b57\u7d22\u5f15\u8bbf\u95ee\uff0c\u800c\u662f\u4f7f\u7528\u952e\u503c\u5bf9\u7684\u5f62\u5f0f\u3002\u952e\u53ef\u4ee5\u662f\u4efb\u610f\u5b57\u7b26\u4e32\uff08\u9664\u4e86\u7a7a\u5b57\u7b26\u4e32\uff09\uff0c\u800c\u503c\u53ef\u4ee5\u662f\u4efb\u4f55 awk \u7684\u53d8\u91cf\u7c7b\u578b\uff0c\u5305\u62ec\u6570\u5b57\u3001\u5b57\u7b26\u4e32\u6216\u5176\u4ed6\u6570\u7ec4\uff08\u591a\u7ef4\u6570\u7ec4\uff09\u3002\u4e0b\u9762\u662f\u4e00\u4e9b\u5173\u4e8e\u5982\u4f55\u5728 awk \u4e2d\u4f7f\u7528\u6570\u7ec4\u7684\u57fa\u672c\u4fe1\u606f\u548c\u4f8b\u5b50<\/p>\n<h4 data-spm-anchor-id=\"5176.28103460.0.i5.5e045d272BkHNb\">\u5b9a\u4e49\u548c\u521d\u59cb\u5316\u6570\u7ec4<\/h4>\n<p>\u5728 awk \u4e2d\u5b9a\u4e49\u6570\u7ec4\u4e0d\u9700\u8981\u58f0\u660e\uff1b\u4f60\u53ea\u9700\u76f4\u63a5\u5f00\u59cb\u4f7f\u7528\u5b83\u5373\u53ef\u3002\u4f8b\u5982\uff1a<\/p>\n<div>\n<div>\n<pre>array[\"key\"] = \"value\"<\/pre>\n<\/div>\n<\/div>\n<p>\u8fd9\u884c\u4ee3\u7801\u521b\u5efa\u4e86\u4e00\u4e2a\u540d\u4e3a array \u7684\u6570\u7ec4\uff0c\u5e76\u5411\u5176\u4e2d\u6dfb\u52a0\u4e86\u4e00\u4e2a\u952e\u4e3a &#8220;key&#8221;\u3001\u503c\u4e3a &#8220;value&#8221; \u7684\u5143\u7d20<\/p>\n<h3>\u4f7f\u7528\u6570\u7ec4<\/h3>\n<h4>\u8bbf\u95ee\u6570\u7ec4\u5143\u7d20<\/h4>\n<p>\u4f60\u53ef\u4ee5\u901a\u8fc7\u952e\u6765\u8bbf\u95ee\u6570\u7ec4\u4e2d\u7684\u5143\u7d20\uff1a<\/p>\n<div>\n<div>\n<pre>print array[\"key\"]<\/pre>\n<\/div>\n<\/div>\n<p data-spm-anchor-id=\"5176.28103460.0.i7.5e045d272BkHNb\">\u5982\u679c\u8be5\u952e\u4e0d\u5b58\u5728\uff0c\u5219\u8fd4\u56de\u7a7a\u5b57\u7b26\u4e32<\/p>\n<h4>\u904d\u5386\u6570\u7ec4<\/h4>\n<p>awk \u63d0\u4f9b\u4e86 for \u5faa\u73af\u6765\u904d\u5386\u6570\u7ec4\u7684\u6240\u6709\u5143\u7d20\u3002\u9700\u8981\u6ce8\u610f\u7684\u662f\uff0cawk \u4e0d\u4fdd\u8bc1\u904d\u5386\u987a\u5e8f\u3002<\/p>\n<div>\n<div>\n<pre>for (key in array) {\r\n    print \"Key:\", key, \"Value:\", array[key]\r\n}<\/pre>\n<\/div>\n<\/div>\n<h4>\u5220\u9664\u6570\u7ec4\u5143\u7d20<\/h4>\n<p>\u4f60\u53ef\u4ee5\u4f7f\u7528 delete \u8bed\u53e5\u6765\u5220\u9664\u6570\u7ec4\u4e2d\u7684\u67d0\u4e2a\u5143\u7d20\uff1a<\/p>\n<div>\n<div>\n<pre>delete array[\"key\"]<\/pre>\n<\/div>\n<\/div>\n<p data-spm-anchor-id=\"5176.28103460.0.i9.5e045d272BkHNb\">\u8fd9\u5c06\u79fb\u9664\u4e0e &#8220;key&#8221; \u76f8\u5173\u8054\u7684\u5143\u7d20\u3002<\/p>\n<h4>\u68c0\u67e5\u6570\u7ec4\u4e2d\u662f\u5426\u5b58\u5728\u67d0\u952e<\/h4>\n<p>\u8981\u68c0\u67e5\u4e00\u4e2a\u7279\u5b9a\u7684\u952e\u662f\u5426\u5b58\u5728\u4e8e\u6570\u7ec4\u4e2d\uff0c\u53ef\u4ee5\u4f7f\u7528 &#8220;key&#8221; in array \u8868\u8fbe\u5f0f\uff1a<\/p>\n<div>\n<pre data-spm-anchor-id=\"5176.28103460.0.i13.5e045d272BkHNb\">if (\"key\" in array) {\r\n    print \"The key exists.\"\r\n} else {\r\n    print \"The key does not exist.\"\r\n}<\/pre>\n<h4>\u591a\u7ef4\u6570\u7ec4<\/h4>\n<p>awk \u652f\u6301\u591a\u7ef4\u6570\u7ec4\uff0c\u4f46\u5b9e\u9645\u4e0a\u5b83\u4eec\u662f\u901a\u8fc7\u5c06\u591a\u4e2a\u952e\u7ec4\u5408\u6210\u4e00\u4e2a\u590d\u5408\u952e\u6765\u5b9e\u73b0\u7684\u3002awk \u4f7f\u7528\u7279\u6b8a\u5b57\u7b26 SUBSEP\uff08\u9ed8\u8ba4\u662f\u4e00\u4e2a\u63a7\u5236\u5b57\u7b26 \\034\uff09\u6765\u5206\u9694\u8fd9\u4e9b\u952e\u3002\u4f8b\u5982\uff1a<\/p>\n<div>\n<div>\n<pre>two_dim_array[\"first\", \"second\"] = \"value\"<\/pre>\n<\/div>\n<\/div>\n<p>\u8981\u8bbf\u95ee\u8fd9\u4e2a\u5143\u7d20\uff0c\u4f60\u53ef\u4ee5\u8fd9\u6837\u5199\uff1a<\/p>\n<div>\n<div>\n<pre>print two_dim_array[\"first\", \"second\"]<\/pre>\n<\/div>\n<\/div>\n<p>\u5982\u679c\u4f60\u60f3\u904d\u5386\u4e00\u4e2a\u591a\u7ef4\u6570\u7ec4\uff0c\u4f60\u9700\u8981\u8bb0\u4f4f SUBSEP \u662f\u7528\u6765\u8fde\u63a5\u952e\u7684\uff1a<\/p>\n<div>\n<pre>for (key in two_dim_array) {\r\n    split(key, keys, SUBSEP)\r\n    print \"Keys:\", keys[1], keys[2], \"Value:\", two_dim_array[key]\r\n}<\/pre>\n<h4>\u6570\u7ec4\u793a\u4f8b<\/h4>\n<p>\u5047\u8bbe\u6211\u4eec\u6709\u4e00\u4e2a\u6587\u4ef6 data.txt\uff0c\u6bcf\u884c\u5305\u542b\u4e00\u4e2a\u56fd\u5bb6\u540d\u548c\u4eba\u53e3\u6570\uff0c\u7528\u9017\u53f7\u5206\u9694\u3002\u6211\u4eec\u53ef\u4ee5\u4f7f\u7528\u6570\u7ec4\u6765\u7edf\u8ba1\u6bcf\u4e2a\u56fd\u5bb6\u7684\u4eba\u53e3\u603b\u6570\uff1a<\/p>\n<div>\n<div>\n<pre># \u5047\u8bbe data.txt \u6587\u4ef6\u5185\u5bb9\u5982\u4e0b\uff1a\r\n# China,1400000000\r\n# India,1366000000\r\n# USA,331000000\r\n\r\nBEGIN { FS=\",\" }\r\n{\r\n    country_population[$1] += $2\r\n}\r\nEND {\r\n    for (country in country_population) {\r\n        print country, country_population[country]\r\n    }\r\n}\r\n\r\nawk 'BEGIN { FS=\",\" } { country_population[$1] += $2 } END { for (country in country_population) print country, country_population[country] }' data.txt | sort\r\n\r\n<\/pre>\n<\/div>\n<\/div>\n<p>\u8fd9\u6bb5\u811a\u672c\u4f1a\u8bfb\u53d6 data.txt \u6587\u4ef6\uff0c\u8ba1\u7b97\u6bcf\u4e2a\u56fd\u5bb6\u7684\u603b\u4eba\u53e3\uff0c\u5e76\u5728\u6700\u540e\u6253\u5370\u51fa\u7ed3\u679c<\/p>\n<h4>\u7edf\u8ba1\u57df\u540d\u8bbf\u95ee\u6b21\u6570<\/h4>\n<p>[root@shell ~]$ cat url.txt<br \/>\nhttp:\/\/www.etiantian.org\/index.html<br \/>\nhttp:\/\/www.etiantian.org\/1.html<br \/>\nhttp:\/\/post.etiantian.org\/index.html<br \/>\nhttp:\/\/mp3.etiantian.org\/index.html<br \/>\nhttp:\/\/www.etiantian.org\/3.html<br \/>\nhttp:\/\/post.etiantian.org\/2.html<\/p>\n<p>[root@shell ~]$ awk -F'[\/.]+&#8217; &#8216;{url[$2]++}END{for(n in url) print n,url[n]}&#8217; url.txt<br \/>\nwww 3<br \/>\nmp3 1<br \/>\npost 2<\/p>\n<h4>-F'[\/.]+&#8217;<\/h4>\n<p>-F\u00a0\u9009\u9879\u7528\u4e8e\u6307\u5b9a\u5b57\u6bb5\u5206\u9694\u7b26\u3002<\/p>\n<p>&#8216;[\/.]+&#8217;\u00a0\u662f\u4e00\u4e2a\u6b63\u5219\u8868\u8fbe\u5f0f\uff0c\u8868\u793a\u4f7f\u7528\u4e00\u4e2a\u6216\u591a\u4e2a\u659c\u6760\u00a0\/\u00a0\u6216\u70b9\u53f7\u00a0.\u00a0\u4f5c\u4e3a\u5b57\u6bb5\u5206\u9694\u7b26\u3002\u8fd9\u610f\u5473\u7740 URL \u4e2d\u7684\u534f\u8bae\uff08\u5982\u00a0http:\/\/\uff09\u3001\u5b50\u57df\u540d\u3001\u9876\u7ea7\u57df\u540d\u7b49\u90fd\u4f1a\u88ab\u5206\u5272\u5f00\u6765\u3002<\/p>\n<h4>{url[$2]++}<\/h4>\n<p>$2\u00a0\u8868\u793a\u7b2c\u4e8c\u4e2a\u5b57\u6bb5\u3002\u7531\u4e8e\u6211\u4eec\u4f7f\u7528\u4e86\u00a0[\/.]+\u00a0\u4f5c\u4e3a\u5206\u9694\u7b26\uff0c\u5bf9\u4e8e\u5927\u591a\u6570\u6807\u51c6\u7684 URL \u683c\u5f0f\uff08\u4f8b\u5982\u00a0http:\/\/example.com\/path\/to\/page\uff09\uff0c$2\u00a0\u5c06\u4f1a\u662f\u4e3b\u57df\u540d\uff08\u5373\u00a0example\uff09\u3002<\/p>\n<p>url[$2]++\u00a0\u521b\u5efa\u4e86\u4e00\u4e2a\u540d\u4e3a\u00a0url\u00a0\u7684\u5173\u8054\u6570\u7ec4\uff0c\u5176\u4e2d\u952e\u4e3a\u00a0$2\uff08\u5373\u4e3b\u57df\u540d\uff09\uff0c\u503c\u4e3a\u8be5\u57df\u540d\u51fa\u73b0\u7684\u6b21\u6570\u3002\u6bcf\u6b21\u9047\u5230\u76f8\u540c\u7684\u57df\u540d\u65f6\uff0c\u8ba1\u6570\u5668\u52a0\u4e00\u3002<\/p>\n<h4>END {for(n in url) print n, url[n]}<\/h4>\n<p>END\u00a0\u5757\u5728\u6240\u6709\u8f93\u5165\u884c\u5904\u7406\u5b8c\u6bd5\u540e\u6267\u884c\u3002<\/p>\n<p>for(n in url)\u00a0\u904d\u5386\u00a0url\u00a0\u6570\u7ec4\u4e2d\u7684\u6bcf\u4e00\u4e2a\u952e\uff08\u5373\u6bcf\u4e2a\u552f\u4e00\u7684\u57df\u540d\uff09\u3002<\/p>\n<p>print n, url[n]\u00a0\u6253\u5370\u51fa\u6bcf\u4e2a\u57df\u540d\u53ca\u5176\u5bf9\u5e94\u7684\u51fa\u73b0\u6b21\u6570\u3002<\/p>\n<h4>\u7edf\u8ba1access.log\u4e2d\u6bcf\u4e2aip\u4f7f\u7528\u7684\u6d41\u91cf\u603b\u548c<\/h4>\n<p>[root@shell ~]$ awk &#8216;{h[$1]=h[$1]+$10} END{for(ip in h)print ip,h[ip]}&#8217; access.log |sort -rnk2 |head<br \/>\n192.168.15.87 66102<br \/>\n192.168.15.252 62367<br \/>\n192.168.15.141 59997<br \/>\n192.168.15.235 36108<br \/>\n192.168.15.254 27252<br \/>\n192.168.15.236 26580<br \/>\n192.168.15.72 16707<br \/>\n192.168.15.49 13395<br \/>\n192.168.15.161 11712<br \/>\n192.168.15.105 9834<\/p>\n<h4>{h[$1]=h[$1]+$10}<\/h4>\n<p>$1\u00a0\u8868\u793a\u6bcf\u884c\u7684\u7b2c\u4e00\u4e2a\u5b57\u6bb5\uff0c\u901a\u5e38\u5728 Web \u670d\u52a1\u5668\u8bbf\u95ee\u65e5\u5fd7\u4e2d\u662f\u5ba2\u6237\u7aef\u7684 IP \u5730\u5740\u3002<\/p>\n<p>$10\u00a0\u8868\u793a\u6bcf\u884c\u7684\u7b2c\u5341\u4e2a\u5b57\u6bb5\uff0c\u8fd9\u901a\u5e38\u5bf9\u5e94\u4e8e HTTP \u54cd\u5e94\u8fd4\u56de\u7ed9\u5ba2\u6237\u7aef\u7684\u6570\u636e\u91cf\uff08\u4ee5\u5b57\u8282\u4e3a\u5355\u4f4d\uff09\u3002\u6ce8\u610f\uff0c\u4e0d\u540c\u683c\u5f0f\u7684\u65e5\u5fd7\u6587\u4ef6\u53ef\u80fd\u6709\u4e0d\u540c\u7684\u5b57\u6bb5\u5e03\u5c40\uff0c\u56e0\u6b64\u4f60\u9700\u8981\u786e\u4fdd\u00a0$10\u00a0\u786e\u5b9e\u662f\u4f60\u60f3\u8981\u7684\u5b57\u6bb5\u3002<\/p>\n<p>h[$1]\u00a0\u662f\u4e00\u4e2a\u5173\u8054\u6570\u7ec4\uff0c\u952e\u662f IP \u5730\u5740\uff08\u5373\u00a0$1\uff09\uff0c\u503c\u662f\u8be5 IP \u5730\u5740\u6240\u6709\u8bb0\u5f55\u4e2d\u00a0$10\u00a0\u5b57\u6bb5\u7684\u7d2f\u8ba1\u548c\u3002<\/p>\n<p>h[$1]=h[$1]+$10\uff1a\u5bf9\u4e8e\u6bcf\u4e00\u884c\uff0c\u5982\u679c\u00a0h[$1]\u00a0\u5df2\u7ecf\u5b58\u5728\uff0c\u5219\u5c06\u5176\u5f53\u524d\u503c\u4e0e\u00a0$10\u00a0\u76f8\u52a0\uff1b\u5982\u679c\u4e0d\u5b58\u5728\uff0c\u5219\u521d\u59cb\u5316\u4e3a\u00a0$10\u3002<\/p>\n<h4>END{for(ip in h)print ip,h[ip]}<\/h4>\n<p>END\u00a0\u5757\u5728\u6240\u6709\u8f93\u5165\u884c\u5904\u7406\u5b8c\u6bd5\u540e\u6267\u884c\u3002<\/p>\n<p>for(ip in h)\u00a0\u904d\u5386\u5173\u8054\u6570\u7ec4\u00a0h\u00a0\u4e2d\u7684\u6bcf\u4e00\u4e2a\u952e\uff08\u5373\u6bcf\u4e2a\u552f\u4e00\u7684 IP \u5730\u5740\uff09\u3002<\/p>\n<p>print ip,h[ip]\u00a0\u6253\u5370\u51fa\u6bcf\u4e2a IP \u5730\u5740\u53ca\u5176\u5bf9\u5e94\u7684\u7d2f\u8ba1\u54cd\u5e94\u5b57\u8282\u6570\u3002<\/p>\n<h4>\u7edf\u8ba1\u6bcf\u4e2aip\u51fa\u73b0\u7684\u6b21\u6570 \u53ca\u4f7f\u7528\u7684\u6d41\u91cf<\/h4>\n<p>[root@shell ~]$ awk &#8216;{ cnt[$1]++; sum[$1]+=$10;} END{ for(ip in cnt) print ip,cnt[ip],sum[ip]}&#8217; access.log |column -t |sort -rn -k2 -k3<\/p>\n<h4>\u5224\u65ad\u78c1\u76d8\u4f7f\u7528\u7387 \u5927\u4e8e70% \u5982\u679c\u5927\u4e8e \u663e\u793a\u78c1\u76d8\u7a7a\u95f4\u4e0d\u8db3 \u5982\u679c\u4e0d\u5927\u4e8e \u663e\u793a\u6b63\u5e38<\/h4>\n<p>[root@shell ~]$ df -h |awk -F'[ %]+&#8217; &#8216;NR&gt;1{if($5&gt;70) print &#8220;\u78c1\u76d8\u7a7a\u95f4\u4e0d\u8db3&#8221;; else print &#8220;\u6b63\u5e38&#8221; };&#8217;<br \/>\n\u6b63\u5e38<br \/>\n\u6b63\u5e38<\/p>\n<p>[root@shell ~]$ df -h |awk -F'[ %]+&#8217; &#8216;NR&gt;1 { percent = gensub(\/%\/, &#8220;&#8221;, &#8220;g&#8221;, $5); if( percent +0 &gt; 70 ) { print &#8220;\u4e0d\u6b63\u5e38(&#8220;$6&#8243;)&#8221; } else { print &#8220;\u6b63\u5e38(&#8220;$6&#8243;)&#8221; ; } }&#8217;<br \/>\n\u6b63\u5e38(\/dev)<br \/>\n\u6b63\u5e38(\/dev\/shm)<br \/>\n\u6b63\u5e38(\/run)<br \/>\n\u6b63\u5e38(\/sys\/fs\/cgroup)<br \/>\n\u6b63\u5e38(\/)<br \/>\n\u6b63\u5e38(\/boot)<br \/>\n\u6b63\u5e38(\/run\/user\/0)<\/p>\n<p>gensub(\/%\/, &#8220;&#8221;, &#8220;g&#8221;, $5)\uff1a\u8fd9\u4e2a\u51fd\u6570\u7528\u4e8e\u5168\u5c40\u66ff\u6362\u00a0$5\u00a0\u4e2d\u7684\u6240\u6709\u00a0%\u00a0\u7b26\u53f7\u4e3a\u7a7a\u5b57\u7b26\u4e32\uff0c\u4ece\u800c\u5f97\u5230\u7eaf\u6570\u5b57\u5b57\u7b26\u4e32\u3002<\/p>\n<p>percent + 0\uff1a\u8fd9\u4e00\u6b65\u662f\u4e3a\u4e86\u786e\u4fdd\u5373\u4f7f\u00a0percent\u00a0\u662f\u7a7a\u5b57\u7b26\u4e32\uff08\u7406\u8bba\u4e0a\u4e0d\u5e94\u8be5\u53d1\u751f\uff09\uff0c\u4e5f\u80fd\u5b89\u5168\u5730\u8f6c\u6362\u4e3a 0\uff0c\u907f\u514d\u6f5c\u5728\u7684\u9519\u8bef\u3002<\/p>\n<p>$6\uff1a\u8fd9\u91cc\u5047\u8bbe\u4f60\u60f3\u8f93\u51fa\u7684\u662f\u6587\u4ef6\u7cfb\u7edf\u540d\uff0c\u5373\u7b2c\u516d\u5217\u3002\u5982\u679c\u4f60\u60f3\u8981\u663e\u793a\u4e0d\u540c\u7684\u4fe1\u606f\uff0c\u8bf7\u6839\u636e\u5b9e\u9645\u9700\u6c42\u8c03\u6574\u3002<\/p>\n<p>NR &gt; 1\uff1a\u8df3\u8fc7\u00a0df -h\u00a0\u8f93\u51fa\u7684\u7b2c\u4e00\u884c\uff08\u6807\u9898\u884c\uff09\u3002<\/p>\n<p>\u8f93\u51fa\u683c\u5f0f\u5316\uff1a\u6211\u6dfb\u52a0\u4e86\u00a0($6)\u00a0\u6765\u6307\u51fa\u54ea\u4e2a\u8bbe\u5907\u7a7a\u95f4\u4e0d\u8db3\u6216\u6b63\u5e38\uff0c\u8fd9\u6837\u53ef\u4ee5\u66f4\u6e05\u695a\u5730\u77e5\u9053\u5177\u4f53\u662f\u54ea\u4e2a\u78c1\u76d8\u6709\u95ee\u9898\u3002<\/p>\n<p>\u6bb5\u5206\u9694\u7b26 -F'[[:space:]]+|%+&#8217;\uff1a<\/p>\n<p>\u4f7f\u7528\u00a0[[:space:]]+\u00a0\u6765\u5339\u914d\u4e00\u4e2a\u6216\u591a\u4e2a\u7a7a\u767d\u5b57\u7b26\uff08\u5305\u62ec\u7a7a\u683c\u548c\u5236\u8868\u7b26\uff09\uff0c\u8fd9\u6bd4\u5355\u72ec\u4f7f\u7528\u7a7a\u683c\u66f4\u7075\u6d3b\u3002<\/p>\n<p>\u4f7f\u7528\u00a0%+\u00a0\u6765\u5339\u914d\u4e00\u4e2a\u6216\u591a\u4e2a\u00a0%\u00a0\u7b26\u53f7\uff0c\u4ee5\u5904\u7406\u53ef\u80fd\u5b58\u5728\u7684\u989d\u5916\u767e\u5206\u53f7\u3002<\/p>\n<p>\u76f4\u63a5\u5bf9\u00a0$5\u00a0\u8fdb\u884c\u00a0+ 0\u00a0\u64cd\u4f5c\u6765\u79fb\u9664\u767e\u5206\u6bd4\u7b26\u53f7\u5e76\u8f6c\u6362\u4e3a\u6570\u503c\u7c7b\u578b\u3002\u56e0\u4e3a\u00a0df -h\u00a0\u7684\u8f93\u51fa\u683c\u5f0f\u76f8\u5bf9\u56fa\u5b9a\uff0c\u8fd9\u6837\u505a\u901a\u5e38\u8db3\u591f\u53ef\u9760<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>1.awk\u6982\u8ff0 \u5b9a\u4e49\uff1aAWK \u662f\u4e00\u79cd\u89e3\u91ca\u578b\u8bed\u8a00\uff0c\u5b83\u9010\u884c\u8bfb\u53d6\u6587\u672c\u8f93\u5165\uff0c\u6839\u636e\u6307\u5b9a\u7684\u6a21\u5f0f\u5bf9\u6bcf\u4e00\u884c\u8fdb\u884c\u5339\u914d\uff0c\u5e76\u6267\u884c\u76f8\u5e94 [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":""},"categories":[5],"tags":[],"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/posts\/96"}],"collection":[{"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=96"}],"version-history":[{"count":9,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/posts\/96\/revisions"}],"predecessor-version":[{"id":1389,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=\/wp\/v2\/posts\/96\/revisions\/1389"}],"wp:attachment":[{"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=96"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=96"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.qiangzhenshuai.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=96"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}