Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: APIs to access knowledge base #717

Open
5 of 9 tasks
JinHai-CN opened this issue May 10, 2024 · 2 comments
Open
5 of 9 tasks

[Feature Request]: APIs to access knowledge base #717

JinHai-CN opened this issue May 10, 2024 · 2 comments
Labels

Comments

@JinHai-CN
Copy link
Contributor

JinHai-CN commented May 10, 2024

Describe the feature you'd like

Related issues

#710 #696 #675 #671 #490 #399 #568 #417 #389

@JinHai-CN JinHai-CN changed the title [Feature Request]: APIs of knowledge base [Feature Request]: APIs to access knowledge base May 10, 2024
@23233
Copy link

23233 commented May 11, 2024

Add Chunks?
Edit Chunks?

@JinHai-CN
Copy link
Contributor Author

Add Chunks? Edit Chunks?

Updated.

@JinHai-CN JinHai-CN mentioned this issue May 11, 2024
14 tasks
KevinHuSh pushed a commit that referenced this issue May 17, 2024
### What problem does this PR solve?

#717 

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
shaoyie pushed a commit to tiwater/ragflow that referenced this issue May 17, 2024
### What problem does this PR solve?

infiniflow#717 

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
shaoyie pushed a commit to tiwater/ragflow that referenced this issue May 17, 2024
### What problem does this PR solve?

infiniflow#717 

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
fkzhao added a commit to aigc-hf/ragflow that referenced this issue May 20, 2024
commit 673a28e
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 20:03:00 2024 +0800

    fix bug of chat without stream (infiniflow#830)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 2bfacd0
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 18:06:20 2024 +0800

    refine doc about API: completion (infiniflow#829)

    ### What problem does this PR solve?
    infiniflow#808

    ### Type of change

    - [x] Documentation Update

commit b3c923d
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 17:51:54 2024 +0800

    add doc ids in API: completion (infiniflow#827)

    ### What problem does this PR solve?
    infiniflow#808

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit a1586e0
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 17:27:39 2024 +0800

    correct mismatched kb doc number (infiniflow#826)

    ### What problem does this PR solve?

    infiniflow#620

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit f6a5994
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 17:07:33 2024 +0800

    fix zhipuAI stream issue (infiniflow#825)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 081f922
Author: GYH <43509927+guoyuhao2330@users.noreply.github.com>
Date:   Fri May 17 15:58:05 2024 +0800

    0517 list chunks (infiniflow#821)

    ### What problem does this PR solve?

    infiniflow#717

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 9f0f5b4
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Fri May 17 15:38:28 2024 +0800

    Default language will be given according to the browse setting and also can be configured infiniflow#801 (infiniflow#823)

    ### What problem does this PR solve?

    Default language will be given according to the browse setting and also
    can be configured infiniflow#801
    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit a2a6a35
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 15:35:09 2024 +0800

    fix doc number miss-match issue (infiniflow#822)

    ### What problem does this PR solve?

    infiniflow#620

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 9e5d501
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 14:33:19 2024 +0800

    fix data init error (infiniflow#820)

    ### What problem does this PR solve?

    infiniflow#810

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 4ca176b
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Fri May 17 14:16:55 2024 +0800

    fix: thumbnails are too large in the chat box infiniflow#818 (infiniflow#819)

    ### What problem does this PR solve?

    fix: thumbnails are too large in the chat box infiniflow#818

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit c3bc72d
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 14:04:21 2024 +0800

    fix too large thumbnail issue (infiniflow#817)

    ### What problem does this PR solve?

    infiniflow#709

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 2dd705f
Author: LiYongHui <46884881+yonghuili1@users.noreply.github.com>
Date:   Fri May 17 13:47:05 2024 +0800

    feat: add feishu oauth (infiniflow#815)

    ### What problem does this PR solve?

    The back-end code adds Feishu oauth

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

    Co-authored-by: yonghui li <yonghui.li@bondex.com.cn>

commit d161410
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 12:07:00 2024 +0800

    fix stream chat for ollama (infiniflow#816)

    ### What problem does this PR solve?

    infiniflow#709

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 05fa3ae
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 09:00:24 2024 +0800

    use smaller docker images (infiniflow#813)

    ### What problem does this PR solve?

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit e73ce39
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Fri May 17 08:51:29 2024 +0800

    Add 2 embeding models from OpenAI (infiniflow#812)

    ### What problem does this PR solve?

    infiniflow#810

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit d54d137
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Thu May 16 21:27:09 2024 +0800

    Initial draft of configure knowledge base (infiniflow#794)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] Documentation Update

commit c6c9dbd
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Thu May 16 20:15:02 2024 +0800

    feat: Support for conversational streaming (infiniflow#809)

    ### What problem does this PR solve?

    feat: Support for conversational streaming
    infiniflow#709

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 95f8091
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 16 20:14:53 2024 +0800

    add stream chat (infiniflow#811)

    ### What problem does this PR solve?

    infiniflow#709
    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit d6772f5
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 16 16:17:48 2024 +0800

    add version (infiniflow#807)

    ### What problem does this PR solve?
    infiniflow#709
    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 63ca15c
Author: lcjia_you <lcjia_you@126.com>
Date:   Thu May 16 10:49:41 2024 +0800

    Fix a bug in 'assistant-setting.tsx' that causes the upload button to… (infiniflow#796)

    … incorrectly appear on the model settings page.

    ### What problem does this PR solve?

    This is an issue with the Upload component on the assistant-setting
    page. I use the show variable to explicitly control the button component
    within it.

    see:

    ![20240516000417](https://github.com/infiniflow/ragflow/assets/37476944/de88f911-6dbd-412d-a981-86cf60aa2257)

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)
    - [x] Other (please describe): Add the local models that DeepDoc depends
    on to the gitignore file in dev mode.

    Signed-off-by: liuchao <lcjia_you@126.com>

commit 7b144cc
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 16 09:10:29 2024 +0800

    fix: can't capitalize file or folder name (infiniflow#798)

    ### What problem does this PR solve?

    infiniflow#792

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 1c4e92e
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 16 09:00:12 2024 +0800

    Knowledge base search is case sensitive (infiniflow#797)

    ### What problem does this PR solve?
    infiniflow#793
    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 10e83f2
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Wed May 15 20:02:41 2024 +0800

    Added file management guide (infiniflow#788)

    ### What problem does this PR solve?

    Added guide with instructions on managing files in RAGFlow.

    ### Type of change

    - [x] Documentation Update

commit 6ff63ee
Author: dashi6174 <dashi6174@163.com>
Date:   Wed May 15 16:34:28 2024 +0800

    Support for code files parse (infiniflow#789)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 12b4c56
Author: GYH <43509927+chenshuizhong@users.noreply.github.com>
Date:   Wed May 15 16:33:28 2024 +0800

    Updated conversation_api.md document/upload (infiniflow#787)

    ### What problem does this PR solve?

    Updated conversation_api.md document/upload parameter description

    ### Type of change

    - [x] Documentation Update

commit baad35d
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Wed May 15 14:53:36 2024 +0800

    fix: .knowledgebase folder can be deleted bug and change "Add file to knowledge base" to "Link file to knowledge base" bug (infiniflow#786)

    ### What problem does this PR solve?
    fix: .knowledgebase folder can be deleted bug
    fix: change "Add file to knowledge base" to "Link file to knowledge
    base" bug
    infiniflow#783 infiniflow#784

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 5effbfa
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Wed May 15 13:58:30 2024 +0800

    fix: remove Top K in retrieval testing  infiniflow#770 and if the document parsing fails, the error message returned by the backend is displayed (infiniflow#782)

    ### What problem does this PR solve?

    fix: remove Top K in retrieval testing  infiniflow#770
    fix: if the document parsing fails, the error message returned by the
    backend is displayed.

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 4d47b2b
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 15 13:02:31 2024 +0800

    fix a string format error (infiniflow#781)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit d8c080e
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 15 12:51:57 2024 +0800

    fix bugs in searching file using keywords (infiniflow#780)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 626ace8
Author: GYH <43509927+chenshuizhong@users.noreply.github.com>
Date:   Wed May 15 12:22:11 2024 +0800

    Updated document upload method (infiniflow#777)

    ### What problem does this PR solve?

    api_app.py
    /document/upload
    add two non mandatory parameters
    parser_id:
    [naive,qaresume,manual,table,paper,book,laws,presentation,picture,one]
    run: 1

    ### Type of change
    - [x] New Feature (non-breaking change which adds functionality)

commit 1e923f1
Author: Jin Hai <haijin.chn@gmail.com>
Date:   Wed May 15 12:08:32 2024 +0800

    Update README (infiniflow#779)

    ### What problem does this PR solve?

    infiniflow#771

    ### Type of change

    - [x] Documentation Update

    ---------

    Signed-off-by: Jin Hai <haijin.chn@gmail.com>

commit 234afb2
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Wed May 15 11:34:57 2024 +0800

    feat: support GPT-4o  infiniflow#771 and hide the add button when the folder is a knowledge base (infiniflow#775)

    ### What problem does this PR solve?

    feat: support GPT-4o  infiniflow#771

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit aa1c915
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 15 11:16:08 2024 +0800

    support gpt-4o (infiniflow#773)

    ### What problem does this PR solve?
    infiniflow#771

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 77b1520
Author: Jin Hai <haijin.chn@gmail.com>
Date:   Wed May 15 10:48:42 2024 +0800

    Refactor message output format (infiniflow#772)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] Refactoring

    Signed-off-by: Jin Hai <haijin.chn@gmail.com>

commit 6b06cce
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Tue May 14 18:46:39 2024 +0800

    Miscellaneous updates (infiniflow#769)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] Documentation Update

commit 282f085
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Tue May 14 16:53:32 2024 +0800

    fix: hide the add button when the folder is a knowledge base (infiniflow#765)

    ### What problem does this PR solve?

    infiniflow#764 fix: hide the add button when the folder is a knowledge base

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit d7744f5
Author: Jin Hai <haijin.chn@gmail.com>
Date:   Tue May 14 14:48:15 2024 +0800

    Refactor method name (infiniflow#760)

    ### What problem does this PR solve?

    infiniflow#757

    ### Type of change

    - [x] Refactoring

    Signed-off-by: Jin Hai <haijin.chn@gmail.com>

commit 9b21b66
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Tue May 14 12:22:33 2024 +0800

    Create quickstart.md (infiniflow#743)

    ### What problem does this PR solve?

    Draft quickstart.

    ### Type of change

    - [x] Documentation Update

commit aa03dfa
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Mon May 13 14:02:38 2024 +0800

    fix bug of get file (infiniflow#746)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 69b7c61
Author: Sawyer <35255629+shaoyie@users.noreply.github.com>
Date:   Mon May 13 09:25:45 2024 +0800

    fix: typo in user_app.py (infiniflow#740)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] Bug Fix (non-breaking change
    - [x] Other (please describe): Fix typo

commit 8769619
Author: Jin Hai <haijin.chn@gmail.com>
Date:   Sun May 12 13:40:47 2024 +0800

    Update readme (infiniflow#741)

    ### What problem does this PR solve?

    Update readme.

    ### Type of change

    - [x] Documentation Update

    Signed-off-by: Jin Hai <haijin.chn@gmail.com>

commit ffe5737
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Sat May 11 19:47:53 2024 +0800

    let index be batchly. (infiniflow#733)

    ### What problem does this PR solve?

    let index be batchly.

    ### Type of change

    - [x] Refactoring

commit 04a9e95
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Sat May 11 16:04:28 2024 +0800

    let file in knowledgebases visible in file manager (infiniflow#714)

    ### What problem does this PR solve?

    Let file in knowledgebases visible in file manager.
    infiniflow#162

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 91b4a18
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Sat May 11 16:03:07 2024 +0800

    Make the app name configurable even after the project is built (infiniflow#731)

    ### What problem does this PR solve?

    Make the app name configurable even after the project is built infiniflow#730

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit 33eaf6f
Author: Ikko Eltociear Ashimine <eltociear@gmail.com>
Date:   Fri May 10 12:22:40 2024 +0900

    docs: update README_ja.md (infiniflow#707)

    ### What problem does this PR solve?

    _Briefly describe what this PR aims to solve. Include background context
    that will help reviewers understand the purpose of the PR._

    ### Type of change

    - [x] Documentation Update

commit d65ba3e
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Fri May 10 10:38:39 2024 +0800

    feat: delete the added model infiniflow#503 and display an error message when the requested file fails to parse infiniflow#684  (infiniflow#708)

    ### What problem does this PR solve?

    feat: delete the added model infiniflow#503
    feat: display an error message when the requested file fails to parse
    infiniflow#684

    ### Type of change

    - [x] New Feature (non-breaking change which adds functionality)

commit bef1bbd
Author: CKLogic <chuanzyz@sina.com>
Date:   Fri May 10 09:48:50 2024 +0800

    Update README with Detailed WebUI Service Launch Instructions (infiniflow#694)

    ### What problem does this PR solve?

    Improve README by detailing Launch Service from Source section

    This commit enhances the README document by adding comprehensive steps
    for running the WebUI service in the 'Launch Service from Source'
    section. It aims to provide clearer guidance for users attempting to
    start the service from the source code, making the setup process more
    accessible and understandable.

    Key changes include:
    - Detailed instructions for setting up and running the WebUI service.
    - Necessary prerequisites for launching the service from source.

    This update ensures that users have all the information they need to
    successfully launch the service, improving the overall usability of our
    project.

    ### Type of change

    - [x] Documentation Update

commit 6b36f31
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Fri May 10 09:48:24 2024 +0800

    Minor editorial updates (infiniflow#700)

    ### What problem does this PR solve?

    Editorial updates only.

    ### Type of change

    - [x] Documentation Update

commit 648a2ba
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 9 15:32:24 2024 +0800

    fix disabled doc is still retreivalable (infiniflow#695)

    ### What problem does this PR solve?

    Fix that disabled doc is still retreivalable

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 9392b8b
Author: writinwaters <93570324+writinwaters@users.noreply.github.com>
Date:   Thu May 9 12:37:45 2024 +0800

    0509 faq (infiniflow#693)

    ### What problem does this PR solve?

    Editorial updates only.

    ### Type of change

    - [x] Documentation Update

commit 4153a36
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Thu May 9 11:35:08 2024 +0800

    truncate text to fitin embedding model (infiniflow#692)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Refactoring

commit bca63ad
Author: GYH <43509927+chenshuizhong@users.noreply.github.com>
Date:   Thu May 9 11:32:36 2024 +0800

    Update faq.md (infiniflow#685)

    ### What problem does this PR solve?

    Updated FAQ: How to upgrade RAGFlow

    ### Type of change

    - [x] Documentation Update

commit 793e29f
Author: balibabu <cike8899@users.noreply.github.com>
Date:   Thu May 9 11:30:15 2024 +0800

    fix: fix uploaded file time error infiniflow#680 (infiniflow#690)

    ### What problem does this PR solve?

    fix: fix uploaded file time error infiniflow#680
    feat: support preview of word and excel infiniflow#684

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 99be226
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 8 20:00:14 2024 +0800

    fix coordinate error (infiniflow#686)

    ### What problem does this PR solve?

    infiniflow#683

    ### Type of change

    - [x] Bug Fix (non-breaking change which fixes an issue)

commit 7ddb2f1
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 8 15:20:45 2024 +0800

    make sure to raise exception if redis is not there (infiniflow#674)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Refactoring

commit c28f7b5
Author: KevinHuSh <kevinhu.sh@gmail.com>
Date:   Wed May 8 13:58:41 2024 +0800

    make sure  the error will be recorded. (infiniflow#672)

    ### What problem does this PR solve?

    ### Type of change

    - [x] Refactoring
KevinHuSh pushed a commit that referenced this issue May 22, 2024
### What problem does this PR solve?
#717 

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
KevinHuSh pushed a commit that referenced this issue May 22, 2024
### What problem does this PR solve?

Add api.md:/api/list_kb_docs/ description
#717 

### Type of change

- [x] Documentation Update
KevinHuSh pushed a commit that referenced this issue May 23, 2024
### What problem does this PR solve?

Delete files from a knowledge base.

#717 

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
JinHai-CN pushed a commit that referenced this issue May 23, 2024
### What problem does this PR solve?

Update api_md document/rm
#717 

### Type of change

- [x] Documentation Update
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants