C語言實現詞法分析器：從零構建編譯器前端核心

引言

詞法分析是編譯器前端的第一道關卡，負責將源代碼字符流轉換為有意義的記號流。本文將帶您深入一個經典的C語言詞法分析器實現，解析其核心模組設計、狀態轉移邏輯以及關鍵數據結構，助您掌握編譯原理落地的關鍵技術。

整體架構設計

該分析器採用模組化設計，主要包含輸入處理、詞法掃描、記號識別、類型判斷與結果輸出五大核心模組。通過全局符號表管理保留字、運算符與分隔符，採用有限狀態自動機（DFA）思想實現字符流的識別與分類。

核心數據結構

// 保留字表（32個C語言關鍵字）
char sign_reserved_word[][MAX_LENGTH] = {
    "auto","double","int","struct","break","else","long","switch",
    "case","enum","register","typedef","char","extern","return","union",
    "const","float","short","unsigned","continue","for","signed","void",
    "default","goto","sizeof","volatile","do","if","while","static"
};

// 運算符表（5種基本算術運算符）
char sign_operator[][MAX_LENGTH] = {"+","-","*","/","%"};

// 分隔符表（16種包含空白、標點、括號等）
char sign_separator[][MAX_LENGTH] = {
    "\n"," ","\"","\t",",",";",":","'","<",">","(",")","{","}","[","]"
};

關鍵算法流程

1. 輸入處理模組

採用字符級讀取策略，支持退格刪除、換行處理及ESC鍵退出。輸入緩衝區大小500字符，提供交互式命令行體驗。

2. 詞法掃描核心：parse2Array

掃描器按字符類型分發處理邏輯：

• 運算符/分隔符：單字符直接成記號
• 標識符/關鍵字：字母開頭，後接字母/數字/下劃線
• 數字常量：連續數字序列
• 非法字符：單獨記錄標記

void parse2Array(char* str) {
    int count = strlen(str);
    for(int i=0; i