Skip to content

多个算子要操作的数据域不一样如何设置? #728

@edc3000

Description

@edc3000

Before Asking 在提问之前

  • I have read the README carefully. 我已经仔细阅读了 README 上的操作指引。

  • I have pulled the latest code of main branch to run again and the problem still existed. 我已经拉取了主分支上最新的代码,重新运行之后,问题仍不能解决。

Search before asking 先搜索,再提问

  • I have searched the Data-Juicer issues and found no similar questions. 我已经在 issue列表 中搜索但是没有发现类似的问题。

Question

  1. 如果同一个算子(如document_minhash_deduplicator)先去重instruction,再去重answer,配置上如何设计?能支持吗?
  2. 类似的问题,不同的算子都设置不一样的待处理数据项,如何配置

Additional 额外信息

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions