Py系列

锁定版本:: 3.10.16
生命周期:: 2021-10-04~2026-10
文档:: https://docs.python.org/zh-cn/3.10/
github地址:: https://github.com/python/cpython
版本生命周期:: https://devguide.python.org/versions/
参考:: https://pythonguidecn.readthedocs.io/zh/latest/
awesome-python:: https://github.com/vinta/awesome-python
awesome-python.cn:: https://github.com/jobbole/awesome-python-cn
视频教学:: 黑马程序员python教程，8天python从入门到精通，学python看这套就够了
下载地址:: https://www.python.org/downloads/
风向标项目:: django

参见

官方文档: https://docs.python.org/zh-cn/3.10/using/unix.html
B站: Linux系统上升级安装Python3.10 (Centos)
B站: 在Ubuntu服务器安装Python 3.10
官网安装包: https://www.python.org/ftp/python/3.10.12/Python-3.10.16.tgz

源码构建Python

在root账号操作

官网下载慢，建议在镜像源下载: https://registry.npmmirror.com/binary.html?path=python/

$ wget https://registry.npmmirror.com/-/binary/python/3.10.16/Python-3.10.16.tgz
$ tar -zxvf Python-3.10.16.tgz
$ cd Python-3.10.16/
$ sudo apt-get update
$ sudo apt-get upgrade
$ sudo apt-get dist-upgrade
$ sudo apt-get install python-dev
$ sudo apt-get install libffi-dev
$ sudo apt-get install libssl-dev
$ sudo apt-get install -y make build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev wget curl llvm libncurses5-dev libncursesw5-dev xz-utils tk-dev
$ ./configure --prefix=/usr/local/python3.10
$ make -j8
$ make altinstall
$ ./configure -C \
    --with-openssl=/usr/local/custom-openssl \
    --with-openssl-rpath=auto \
    --prefix=/usr/local/python3.10
$ ln -s /usr/local/python3.10/bin/python3.10 /usr/local/bin/python3.10
$ ln -s /usr/local/python3.10/bin/pip3.10 /usr/local/bin/pip3.10

加入环境变量(可选)

编辑 ~/.bashrc 和 $HOME/.profile

添加一行脚本

export PATH=$PATH:/usr/local/python3.10/bin/

安装sqlite3

解决无法import _sqlite3的问题

https://blog.csdn.net/line_on_database/article/details/116058659

安装ssl

解决无法import _ssl的问题

第一种: 升级openssl

操作步骤参考文档: https://docs.python.org/zh-cn/3.10/using/unix.html#custom-openssl

第二种: libressl

警告

实践中，发现Python3.10仍然安装不了_ssl，3.10+只能使用openssl

https://blog.csdn.net/weixin_39703551/article/details/111795468

缺失_lzma模块

$ apt-get install liblzma-dev -y

然后重新编译python

ai

sentence-transformers

锁定版本:: 4.1.0(2025-04-15)
github:: https://github.com/UKPLab/sentence-transformers
文档:: https://www.sbert.net/index.html

在向量数据库召回重排打分时使用, 中文模型建议用BAAI/bge-reranker-large

ollama

在本地运行大模型, 对硬件有一定的要求

锁定版本:: 0.6.5(2025-03-12 ~ 2025-04-06)
github:: https://github.com/ollama/ollama

参见

Ollama 与 LM Studio，本地 AI 推理工具怎么选？

streamlit

构建前端ui的玩具

锁定版本:: 1.41.1(2024-12-11 ~ 2024-12-14)
文档:: https://docs.streamlit.io/
github:: https://github.com/streamlit/streamlit

zhipuai

(在嵌入模型使用)

锁定版本:: 2.1.5.20250106(2024-08-30 ~ 2025-01-06)
文档:: https://open.bigmodel.cn/dev/howuse/introduction

后端

Django

锁定版本:: 5.0.13(2023-12-04 ~ 2025-03-06)
文档:: https://docs.djangoproject.com/zh-hans/5.0/
github:: https://github.com/django/django
最新版本:: 5.1.7(2025-03-06)
风向标项目:: cookiecutter-django 的实例化项目

django-filter

锁定版本:: 25.1(2025-02-15)
文档:: https://django-filter.readthedocs.io/en/latest/index.html
github:: https://github.com/carltongibson/django-filter

django-environ

锁定版本:: 0.12.0(2025-01-14)
文档:: https://django-environ.readthedocs.org/
github:: https://github.com/joke2k/django-environ

django-compressor

帮助优化和减少网页加载时间，在django template中使用

锁定版本:: 4.5.1(2024-06-17 ~ 2024-07-22)
文档:: https://django-compressor.readthedocs.io/en/latest/
github:: https://github.com/django-compressor/django-compressor

djangorestframework

锁定版本:: 3.15.2(2024-03-17 ~ 2024-06-19)
文档:: https://www.django-rest-framework.org/
github:: https://github.com/encode/django-rest-framework

django-vite

锁定版本:: 3.0.6(2023-11-15 ~ 2024-12-31)
github:: https://github.com/MrBin99/django-vite

django-configurations

锁定版本:: 2.5.1(2023-10-21 ~ 2024-03-27)
文档:: https://django-configurations.readthedocs.io/en/latest/
github:: https://github.com/jazzband/django-configurations

Fastapi

锁定版本:: 0.115.6(2024-09-28 ~ 2024-12-04)
文档:: https://fastapi.tiangolo.com/
github:: https://github.com/fastapi/fastapi
风向标项目:: https://github.com/fastapi/full-stack-fastapi-template

Pandas

锁定版本:: 2.1.4(2023-08-30 ~ 2023-12-08)
文档:: https://pandas.pydata.org/docs/
github:: https://github.com/pandas-dev/pandas

drf-spectacular

锁定版本:: 0.28.0(2024-11-30)
文档:: https://drf-spectacular.readthedocs.io/
github:: https://github.com/tfranzel/drf-spectacular

django-redis

可以使用原生的redis执行脚本

锁定版本:: 5.4.0(2023-10-02)
文档:: https://github.com/jazzband/django-redis?tab=readme-ov-file#user-guide
github:: https://github.com/jazzband/django-redis
最新版本:: (2025.3.19)

ORM

sqlalchemy

锁定版本:: 2.0.36(2023-01-27 ~ 2024-10-16)
文档:: https://docs.sqlalchemy.org/
github:: https://docs.sqlalchemy.org/en/20/

sqlmodel

sqlalchemy的浅层封装

锁定版本:: 0.0.22(2021-08-24 ~ 2024-08-31)
文档:: https://sqlmodel.tiangolo.com
github:: https://github.com/fastapi/sqlmodel

sqlacodegen

锁定版本:: 2.3.0.post1(2020-07-13 ~ 2023-03-06)
github:: https://github.com/agronholm/sqlacodegen

插件

django-ninja

需要注意的是作者是一名乌克兰人，居住在哈尔科夫

锁定版本:: 1.3.0(2024-08-15)
文档:: https://django-ninja.dev
github:: https://github.com/vitalik/django-ninja

sphinx-tabs

锁定版本:: 3.4.5(2022-06-25 ~ 2024-01-21)
文档:: https://sphinx-tabs.readthedocs.io/
github:: https://github.com/executablebooks/sphinx-tabs

pydantic-settings

锁定版本:: 2.7.0(2024-12-13)
文档:: https://docs.pydantic.dev/latest/concepts/pydantic_settings/
github:: https://github.com/pydantic/pydantic-settings

测试

Faker

锁定版本:: 37.0.1(2025-03-07 ~ 2025-03-19)
文档:: https://faker.readthedocs.io/en/stable/
github:: https://github.com/joke2k/faker

pytest-django

锁定版本:: 4.9.0(2024-09-02)
文档:: https://pytest-django.readthedocs.io/en/latest/index.html
github:: https://github.com/pytest-dev/pytest-django
变更日志:: https://pytest-django.readthedocs.io/en/latest/changelog.html

pytest

锁定版本:: 8.0.2(2024-01-02 ~ 2024-02-25)
文档:: https://docs.pytest.org/en/stable/
github:: https://github.com/pytest-dev/pytest
变更日志:: https://docs.pytest.org/en/stable/changelog.html
最新版本:: 8.3.5(2025-03-02)

pytest-cookies

锁定版本:: 0.7.0(2023-05-22)
文档:: https://github.com/hackebrot/pytest-cookies?tab=readme-ov-file#usage
github:: https://github.com/hackebrot/pytest-cookies

pytest-xdist

并行执行用例

锁定版本:: 3.6.1(2024-04-29)
文档:: https://pytest-xdist.readthedocs.io/en/stable/
github:: https://github.com/pytest-dev/pytest-xdist

pytest-mock

锁定版本:: 3.14.0
文档:: https://pytest-mock.readthedocs.io/en/latest
github:: https://github.com/pytest-dev/pytest-mock/

freezegun

锁定版本:: 1.5.1(2024-04-24 ~ 2024-05-12)
文档:: https://github.com/spulec/freezegun/blob/master/README.rst
github:: https://github.com/spulec/freezegun

testcontainers

锁定版本:: 4.8.2(2024-06-28 ~ 2024-10-14)
文档:: https://testcontainers-python.readthedocs.io/en/latest/
github:: https://github.com/testcontainers/testcontainers-python

coverage

明确支持Ukraine

锁定版本:: 7.6.12(2024-07-12 ~ 2025-02-11)
文档:: https://coverage.readthedocs.io/
github:: https://github.com/nedbat/coveragepy
变更日志:: https://coverage.readthedocs.io/en/7.6.9/changes.html

pytest-playwright

锁定版本:: 0.6.2(2024-11-26)
文档:: https://playwright.dev/python/docs/intro
github:: https://github.com/microsoft/playwright-pytest

pytest-asyncio

锁定版本:: 0.25.3(2024-12-13 ~ 2025-01-29)
文档:: https://pytest-asyncio.readthedocs.io/en/latest/
github:: https://github.com/pytest-dev/pytest-asyncio

factory-boy

锁定版本:: 3.3.3(2023-07-19 ~ 2025-02-03)
文档:: https://factoryboy.readthedocs.io/
github:: https://github.com/FactoryBoy/factory_boy

文档

sphinx

锁定版本:: 7.3.7(2024-4-17 ~ 2024-4-19)
文档:: https://www.sphinx-doc.org/
github:: https://github.com/sphinx-doc/sphinx
变更日志:: https://www.sphinx-doc.org/en/master/changes/index.html

sphinx-rtd-theme

锁定版本:: 2.0.0(2023-11-28)
文档:: https://sphinx-rtd-theme.readthedocs.io/en/stable/
github:: https://github.com/readthedocs/sphinx_rtd_theme

sphinx-autobuild

锁定版本:: 2024.10.3(2024-10-03)
文档:: https://github.com/sphinx-doc/sphinx-autobuild?tab=readme-ov-file#sphinx-autobuild
github:: https://github.com/sphinx-doc/sphinx-autobuild

sphinx-copybutton

锁定版本:: 0.5.2(2022-02-06 ~ 2023-04-14)
文档:: https://sphinx-copybutton.readthedocs.io/en/latest/
github:: https://github.com/executablebooks/sphinx-copybutton
最新版本:: (2025-03-13)

运维

ansible

锁定版本:: 9.13.0(2023-11-12 ~ 2024-12-04)
文档:: https://docs.ansible.com/ansible/latest/index.html
github:: https://github.com/ansible/ansible
changelog:: https://docs.ansible.com/ansible/latest/porting_guides/porting_guides.html & https://github.com/ansible-community/ansible-build-data/blob/main/9/CHANGELOG-v9.rst

应用于部署基础设施及配置文件存储和生效, 例如buildbot、prometheus、nginx等

ansible-lint

锁定版本:: 24.2.3(2024-02-07 ~ 2024-4-30)
文档:: https://ansible.readthedocs.io/projects/lint/
github:: https://github.com/ansible/ansible-lint
changelog:: Not Found

supervisor

锁定版本:: 4.2.5(2020-05-01 ~ 2022-12-24)
文档:: http://supervisord.org/
github:: https://github.com/Supervisor/supervisor

buildbot

锁定版本:: 3.11.9(2024-01-26 ~ 2024-10-14)
文档:: https://docs.buildbot.net/current/index.html
github:: https://github.com/buildbot/buildbot

模板

jinja2

锁定版本:: 3.1.5(2022-03-24 ~ 2024-12-22)
文档:: https://jinja.palletsprojects.com/
github:: https://github.com/pallets/jinja
重要程度:: ***

cookiecutter

锁定版本:: 2.6.0(2024-02-22)
文档:: https://cookiecutter.readthedocs.io/en/stable/index.html
github:: https://github.com/cookiecutter/cookiecutter

提供从需求到落地的解决方案
工作环境的低代码工具

抽象企业项目代码风格，将开发思路模板起来, 然后根据实际业务填充业务代码(业务代码没办法模板)

例如excel导入

@action
def imports(self, request, *args, **kwargs):
    # 调用封装好的excel处理函数
    pass

    # ....
    pass

    # ...
    pass

cookiecutter-django

锁定版本:: 2024.10.30(2024-10-30)
文档:: https://cookiecutter-django.readthedocs.io/en/latest
github:: https://github.com/cookiecutter/cookiecutter-django

序列化

marshmallow-dataclass

好处: IDE类型提示

锁定版本:: 8.7.1(2024-06-24 ~ 2024-09-13)
文档:: https://lovasoa.github.io/marshmallow_dataclass/html/marshmallow_dataclass.html
github:: https://github.com/lovasoa/marshmallow_dataclass

http客户端

requests

锁定版本:: 2.32.3(2024-05-20 ~ 2024-05-29)
文档:: https://requests.readthedocs.io/en/latest/
github:: https://github.com/psf/requests

有空去了解下 https://httpbin.org/

aiohttp

锁定版本:: 3.11.7(2024-11-14 ~ 2024-11-21)
文档:: https://aiohttp.readthedocs.io/
github:: https://github.com/aio-libs/aiohttp

开发工具

uv

由rust编写, 集pyenv、venv、pip等功能于一身的强大工具

锁定版本:: 0.6.4(2025-02-15 ~ 2025-03-04)
文档:: https://docs.astral.sh/uv/
github:: https://github.com/astral-sh/uv

invoke

make命令的平替工具

锁定版本:: 2.2.0(2023-07-13)
文档:: https://docs.pyinvoke.org/en/stable/
github:: https://github.com/pyinvoke/invoke

ipdb

锁定版本:: 0.13.13(2020-2-28 ~ 2023-05-09)
github:: https://github.com/gotcha/ipdb

bpython

锁定版本:: 0.25(2025-01-17)
文档:: https://docs.bpython-interpreter.org/en/latest/index.html
github:: https://github.com/bpython/bpython

watchfiles

锁定版本:: 1.0.4(2024-11-25 ~ 2025-01-10)
文档:: https://watchfiles.helpmanual.io/
github:: https://github.com/samuelcolvin/watchfiles

爬虫

scrapy

锁定版本:: 2.10.1(2023-08-04 ~ 2023-08-31)
文档:: https://docs.scrapy.org/
github:: https://github.com/scrapy/scrapy
变更日志:: https://docs.scrapy.org/en/latest/news.html
视频教程:: https://www.bilibili.com/video/BV1gA4m1G7zk

scrapy-playwright

锁定版本:: 0.0.42(2024-11-06)
github:: https://github.com/scrapy-plugins/scrapy-playwright
变更日志:: https://pypi.org/project/scrapy-playwright/docs/changelog.md

beautifulsoup4

锁定版本:: 4.13.3(2025-02-03 ~ 2025-02-05)
文档:: https://www.crummy.com/software/BeautifulSoup/bs4/doc/

异步任务

django-celery-beat

锁定版本:: 2.7.0(2024-08-22)
文档:: https://django-celery-beat.readthedocs.io/en/latest/
github:: http://github.com/celery/django-celery-beat
变更日志:: https://django-celery-beat.readthedocs.io/en/latest/changelog.html
关注issue:: https://github.com/celery/django-celery-beat/issues/798

celery

锁定版本:

5.4.0(2024-04-18)

文档:

https://docs.celeryq.dev/en/stable/index.html

github:

https://github.com/celery/celery

最新版本:

(2025-03-13)

flower

锁定版本:: 2.0.1(2023-06-18 ~ 2023-08-13)
文档:: https://flower.readthedocs.io/
github:: https://github.com/mher/flower
最新确认:: 2025-03-24

web服务

gunicorn

锁定版本:: 23.0.0(2024-08-11)
文档:: https://docs.gunicorn.org/en/stable/
github:: https://github.com/benoitc/gunicorn
变更日志:: https://docs.gunicorn.org/en/stable/news.html