Welcome to Robustness GymΒΆ
Robustness Gym is a toolkit for evaluating natural language processing models.
Robustness Gym is under active development so expect rough edges. Feedback and contributions are welcomed and appreciated. You can submit bugs and feature suggestions on Github Issues and submit contributions using a pull request.
You can get started by going to the installation page.
- API Reference
- robustnessgym.active package
- robustnessgym.core package
- Submodules
- robustnessgym.core.constants module
- robustnessgym.core.dataset_to_task module
- robustnessgym.core.decorators module
- robustnessgym.core.devbench module
- robustnessgym.core.identifier module
- robustnessgym.core.metrics module
- robustnessgym.core.model module
- robustnessgym.core.operation module
- robustnessgym.core.slice module
- robustnessgym.core.storage module
- robustnessgym.core.testbench module
- robustnessgym.core.tools module
- robustnessgym.core.version module
- Module contents
- robustnessgym.demos package
- robustnessgym.logging package
- robustnessgym.nlp package
- robustnessgym.ops package
- robustnessgym.report package
- robustnessgym.slicebuilders package
- Subpackages
- robustnessgym.slicebuilders.attacks package
- robustnessgym.slicebuilders.subpopulations package
- Submodules
- robustnessgym.slicebuilders.subpopulations.constituency_overlap module
- robustnessgym.slicebuilders.subpopulations.entity_frequency module
- robustnessgym.slicebuilders.subpopulations.hans module
- robustnessgym.slicebuilders.subpopulations.length module
- robustnessgym.slicebuilders.subpopulations.lexical_overlap module
- robustnessgym.slicebuilders.subpopulations.phrase module
- robustnessgym.slicebuilders.subpopulations.score module
- robustnessgym.slicebuilders.subpopulations.similarity module
- robustnessgym.slicebuilders.subpopulations.wordlists module
- Module contents
- robustnessgym.slicebuilders.transformations package
- Submodules
- robustnessgym.slicebuilders.transformations.eda module
- robustnessgym.slicebuilders.transformations.fairseq module
- robustnessgym.slicebuilders.transformations.gpt3 module
- robustnessgym.slicebuilders.transformations.nlpaug module
- robustnessgym.slicebuilders.transformations.similarity module
- Module contents
- Submodules
- robustnessgym.slicebuilders.attack module
- robustnessgym.slicebuilders.slicebuilder module
- robustnessgym.slicebuilders.slicebuilder_collection module
- robustnessgym.slicebuilders.subpopulation module
- robustnessgym.slicebuilders.subpopulation_collection module
- robustnessgym.slicebuilders.transformation module
- Module contents
- Subpackages
- robustnessgym.tasks package