Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Git同步似乎和SeaweedFS有冲突 #1453

Open
jasonz1360 opened this issue Mar 22, 2024 · 3 comments
Open

Git同步似乎和SeaweedFS有冲突 #1453

jasonz1360 opened this issue Mar 22, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@jasonz1360
Copy link

Bug 描述
Git同步代码,偶然出现文件被删除,重新拉取也没有用

复现步骤
该 Bug 复现步骤如下

  1. 首先设置git,拉取代码。
  2. 本地编写爬虫。
  3. 在此git pull
  4. 出现文件丢失

期望结果
git能正常工作

截屏
截图是我执行 git pull 后的结果,偶尔会出现
截屏2024-03-22 09 15 14

@jasonz1360 jasonz1360 added the bug Something isn't working label Mar 22, 2024
@jasonz1360
Copy link
Author

能否实现多个任务共用一个git项目,这样一个任务一个任务的拉太耗时间了

@jasonz1360
Copy link
Author

git pull 怎么拉取代码,都有文件是删除状态

截屏2024-03-22 09 32 54 截屏2024-03-22 09 33 01

@jasonz1360
Copy link
Author

找到个解决办法,挂载共用目录,这样git只需要sync一次,还省力

举例方法:

volumes:

  • "/opt/.crawlab/master:/root/.crawlab" # 持久化 crawlab 元数据
  • "/opt/crawlab/master:/data" # 持久化 crawlab 数据
  • "/var/crawlab/log:/var/log/crawlab" # 持久化 crawlab 任务日志
  • "/opt/finbase-crawlab:/root/***:rw" # 持久化 crawlab 代码

然后在爬虫的命令里加上root/***开头

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant