feat: 新增db/pipeline数据导入管线，适配5月数据格式

Browse Source

- 整合所有导入脚本到db/pipeline/目录
- config.py: 按月份动态配置数据源路径，支持4月/5月不同目录结构
- import_bill_records_may.py: 5月专用账单导入(51列全渠道订单明细→bill_records + 50列品项销售明细→dish_sales_details)
- import_salary_attendance.py: 添加--salary-file/--attendance-file参数支持动态文件路径
- import_may_data.sh: 5月一键导入脚本(12步全流程)
- run_all.py: 一键全量导入+物化视图刷新编排
- refresh_materialized_views.py: 按依赖顺序刷新38个物化视图
- verify.py/verify_import.py: 数据一致性验证
- README.md: 管线文档

...

This commit is contained in:

freedakgmail

2026-08-18 22:17:26 +08:00

parent 9b3a9cdb4b

commit 2fc1b96f44

14 changed files with 4096 additions and 65 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

db/pipeline/import_monthly_data.py

+1301

File diff suppressed because it is too large Load Diff