两侧同时换到之前的修订记录前一修订版后一修订版 | 前一修订版 |
it:ai:aiassistance [2023-08-16 07:12] – [解决方案] goldentianya | it:ai:aiassistance [2023-08-19 07:13] (当前版本) – [解决方案] goldentianya |
---|
- [[https://www.youtube.com/watch?v=ySus5ZS0b94|OpenAI Embeddings and Vector Databases Crash Course]] {{fa>youtube}} | - [[https://www.youtube.com/watch?v=ySus5ZS0b94|OpenAI Embeddings and Vector Databases Crash Course]] {{fa>youtube}} |
- [[https://www.youtube.com/watch?v=N4nX_rTwKx4&t=318s|OpenAI GPT3 with a Databases - Crash Course]] {{fa>youtube}} | - [[https://www.youtube.com/watch?v=N4nX_rTwKx4&t=318s|OpenAI GPT3 with a Databases - Crash Course]] {{fa>youtube}} |
| - 文献和思路 |
| - [[https://www.51cto.com/article/760672.html|从通才到专才:Fine-tuning与Embedding探索]] |
| |
**语言模型** | **语言模型** |
- {{fa>book?18}} [[https://elasticstack.blog.csdn.net/article/details/102728604?ydreferer=aHR0cHM6Ly9saW5rLmp1ZWppbi5jbi8%3D|Elastic:开发者上手指南]] | - {{fa>book?18}} [[https://elasticstack.blog.csdn.net/article/details/102728604?ydreferer=aHR0cHM6Ly9saW5rLmp1ZWppbi5jbi8%3D|Elastic:开发者上手指南]] |
- {{fa>github}} [[https://github.com/pgvector/pgvector|pgvector]] (posgresSQL数据库的一个扩展,用于保存向量数据) | - {{fa>github}} [[https://github.com/pgvector/pgvector|pgvector]] (posgresSQL数据库的一个扩展,用于保存向量数据) |
| - [[https://github.com/axa-group/nlp.js/blob/master/docs/v4/nlp-intent-logics.md|nlp.js intent logics]] |
| - TensorFlow |
| - [[https://www.youtube.com/watch?v=Lv8ZVoxnX_I|Text classification with TensorFlow and React in JavaScript]] {{fa>youtube}} |
| - [[https://www.youtube.com/watch?v=gE-95nFF4Cc|Intent Recognition with BERT using Keras and TensorFlow 2 in Python | Text Classification Tutorial]] |
| |
**HuggingFace** | **HuggingFace** |
- [[https://huggingface.co/docs/huggingface.js/inference/README|inference api]] ([[https://huggingface.co/inference-api|Price]] 滚动到底下) | - [[https://huggingface.co/docs/huggingface.js/inference/README|inference api]] ([[https://huggingface.co/inference-api|Price]] 滚动到底下) |
- [[https://huggingface.co/docs/transformers.js|Transformer.js]] | - [[https://huggingface.co/docs/transformers.js|Transformer.js]] |
| - [[https://huggingface.co/Xenova|xenova 可以直接用的模型]] |
- [[https://huggingface.co/THUDM/codegeex2-6b|CodeGeex2]] / [[https://huggingface.co/bigcode/starcoder/tree/main|Starcoder(70GB)]] 最新代码模型 {{fa>book}} | - [[https://huggingface.co/THUDM/codegeex2-6b|CodeGeex2]] / [[https://huggingface.co/bigcode/starcoder/tree/main|Starcoder(70GB)]] 最新代码模型 {{fa>book}} |
- [[https://www.bilibili.com/read/cv23898887/|使用 StarCoder 创建一个编程助手]] | - [[https://www.bilibili.com/read/cv23898887/|使用 StarCoder 创建一个编程助手]] |
- [[https://huggingface.co/blog/zh/starcoder|最先进的代码大模型]] | - [[https://huggingface.co/blog/zh/starcoder|最先进的代码大模型]] |
- [[https://tianchi.aliyun.com/search?q=%E5%9F%BA%E4%BA%8Etransformers%E7%9A%84%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86|基于transformers的自然语言处理]] | - [[https://tianchi.aliyun.com/course/956?spm=a2c22.28136470.0.0.57993f2czRiSez&from=search-list|基于transformers的自然语言处理]] |
| |
| |
搜索支持Transformer的models | 搜索支持Transformer的models |
- HF上选择Models页面, | - HF上选择Models页面, |
- 如果没有ONNX的需要自行编译,因为Transformer本身是从python上来的。(参考{{fa>book}}[[https://huggingface.co/docs/transformers.js/custom_usage|onnx]]) | - 如果没有ONNX的需要自行编译,因为Transformer本身是从python上来的。(参考{{fa>book}}[[https://huggingface.co/docs/transformers.js/custom_usage|onnx]]) |
| |
| ===== 语言模型 ===== |
| |
| Feature Extraction, Transformer, zh/en/de: |
| * [[https://huggingface.co/setu4993/smaller-LaBSE/tree/main|smaller-LaBSE]] |
| * [[https://huggingface.co/setu4993/LEALLA-large/tree/main|LEALLA-large]] / [[https://huggingface.co/setu4993/LEALLA-base/tree/main|LEALLA-base]] |
| |
| Question Answering |
| * [[https://huggingface.co/IProject-10/xlm-roberta-base-finetuned-squad2/tree/main|Facebook 训练的模型]] |
| |
| Text generation |
| * [[https://huggingface.co/facebook/xglm-564M/tree/main|xglm-564M]] (FB 的同模型4.5B参数需要10GB文件,太大了) |
| |
| **Langchain** |
| * [[https://js.langchain.com/docs/get_started/installation|js.langchain]] {{fa>book}} |
| * [[https://js.langchain.com/docs/api/chains/classes/RetrievalQAChain|RetrievalQAChain]] |
| * [[https://js.langchain.com/docs/modules/model_io/models/llms/integrations/huggingface_inference|llms hf-inference]] / [[https://js.langchain.com/docs/modules/data_connection/text_embedding/integrations/hugging_face_inference|embedding inference]] |
| * [[https://js.langchain.com/docs/modules/data_connection/vectorstores/integrations/mongodb_atlas|MongoDB]] |
===== Task描述 ===== | ===== Task描述 ===== |
| |