Question about dataprocess of SeeKeR

[ahxchzt]

I'd like to know how you handle data, as you have three different tasks (search query, knowledge, response). During the training process, do you mix these three different types of data together for training, or do you train one task after another once a task is completed? If it's the latter, I'm curious about how you address the issue of catastrophic forgetting.

[mojtaba-komeili]

It is actually the first. We usually multi-task them together.