Skip to content

Conversation

@zoobereq
Copy link
Contributor

@zoobereq zoobereq commented Dec 5, 2024

What does this PR do ?

This PR adds support for minor denomination currencies (e.g. cents for USD). The major - minor currency denomination pairs are stored in a dictionary under data, and may be expanded according to the need and use case. The list of currency symbol - currency name mappings stored in the same directory can likewise be expanded.

Before your PR is "Ready for review"

Pre checks:

  • Have you signed your commits? Use git commit -s to sign.
  • Do all unittests finish successfully before sending PR?
    1. pytest or (if your machine does not have GPU) pytest --cpu from the root folder (given you marked your test cases accordingly @pytest.mark.run_only_on('CPU')).
    2. Sparrowhawk tests bash tools/text_processing_deployment/export_grammars.sh --MODE=test ...
  • If you are adding a new feature: Have you added test cases for both pytest and Sparrowhawk here.
  • Have you added __init__.py for every folder and subfolder, including data folder which has .TSV files?
  • Have you followed codeQL results and removed unused variables and imports (report is at the bottom of the PR in github review box) ?
  • Have you added the correct license header Copyright (c) 2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved. to all newly added Python files?
  • If you copied nemo_text_processing/text_normalization/en/graph_utils.py your header's second line should be Copyright 2015 and onwards Google, Inc.. See an example here.
  • Remove import guards (try import: ... except: ...) if not already done.
  • If you added a new language or a new feature please update the NeMo documentation (lives in different repo).
  • Have you added your language support to tools/text_processing_deployment/pynini_export.py.

PR Type:

  • New Feature
  • Bugfix
  • Documentation
  • Test

If you haven't finished some of the above items you can still open "Draft" PR.

ngachchi and others added 6 commits December 3, 2024 10:16
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Simon Zuberek <szuberek@nvidia.com>
Copy link
Contributor

@github-advanced-security github-advanced-security bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CodeQL found more than 20 potential problems in the proposed changes. Check the Files changed tab for more details.

ngachchi and others added 23 commits December 5, 2024 15:48
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Simon Zuberek <szuberek@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* ja tn

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* adding ja

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* removing

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* updated tests

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing ci

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing ci

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* addresing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* removing

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* adresing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* removing unused import

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* addressing comment;

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* date for ja

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addresing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* jenkins

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addresing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* typo

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* adressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* addressing comment

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* ci

Signed-off-by: Alex Cui <alexcui1994@gmail.com>

---------

Signed-off-by: Alex Cui <alexcui1994@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* Fixes issue 228

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixes issue 228

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Expands Whitelist and removes redundant [0-9]+-[A-Za-z] (and in reverse) pattern matching from ELECTRONIC

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* Updates the cache

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Removes unused imports and variables

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Removes redundant abbreviation mappings

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

* Updates the cache

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>

---------

Signed-off-by: Simon Zuberek <szuberek@nvidia.com>
Co-authored-by: Simon Zuberek <szuberek@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
…g the file opened

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
…e, Money and Measure (#223)

* Hindi ITN Support for Cardinal, Decimal, Ordinal, Fraction, Date, Time

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Committing all changes made

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updated date.py and added more test cases to cardinal for improved accuracy

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updated date.py

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Added hi to Jenkins and cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Changes and cleanup based on feedback

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Changes and cleanup based on feedback

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Resolved conflicts

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Committing code for measure.py

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* changes to run_evaluate.py

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Hindi ITN for money.py

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Changes and cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup date verbalizer

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* pushing .gitignore file from main branch

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

---------

Signed-off-by: Tarushi V <tarushiv@nvidia.com>
Signed-off-by: tarushi2k2 <tarushiv@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
…d word file

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
pre-commit-ci bot and others added 20 commits December 17, 2024 12:11
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Simon Zuberek <szuberek@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Simon Zuberek <szuberek@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* Fix space issue with ZH ITN

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>

* Update Jenkinsfile

Update FST paths

Signed-off-by: anand-nv <105917641+anand-nv@users.noreply.github.com>

---------

Signed-off-by: Anand Joseph <anajoseph@nvidia.com>
Signed-off-by: anand-nv <105917641+anand-nv@users.noreply.github.com>
Signed-off-by: Simon Zuberek <simon@zuberek.net>
Co-authored-by: Anand Joseph <anajoseph@nvidia.com>
Co-authored-by: anand-nv <105917641+anand-nv@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* contributing update

Signed-off-by: tbartley94 <tbartley@nvidia.com>

* adding edits

Signed-off-by: tbartley94 <tbartley@nvidia.com>

* spelling

Signed-off-by: tbartley94 <tbartley@nvidia.com>

---------

Signed-off-by: tbartley94 <tbartley@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
 into hi_tn

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* Addition of whitelist and word classes

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updation of Jenkins date

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

---------

Signed-off-by: Tarushi V <tarushiv@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* Addition of whitelist and word classes

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updation of Jenkins date

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

---------

Signed-off-by: Tarushi V <tarushiv@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
* Addition of whitelist and word classes

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updation of Jenkins date

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Cleanup

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

* Updation

Signed-off-by: Tarushi V <tarushiv@nvidia.com>

---------

Signed-off-by: Tarushi V <tarushiv@nvidia.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
for more information, see https://pre-commit.ci

Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
@github-actions
Copy link

github-actions bot commented Jan 7, 2025

This PR is stale because it has been open for 14 days with no activity. Remove stale label or comment or update or this will be closed in 7 days.

@github-actions github-actions bot added the Stale label Jan 7, 2025
ngachchi and others added 2 commits January 9, 2025 14:13
Signed-off-by: Namrata Gachchi <ngachchi@nvidia.com>
@github-actions github-actions bot removed the Stale label Jan 10, 2025
@zoobereq zoobereq closed this Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.