Scott Wolchok
|
47d34261e0
|
Rewrite the guts of torch::jit::Lexer to speed it up (#151850)
The trie-based approach was, apparently, not efficient. This incidentally fixes a bug where "not inp" and "is note" were lexed incorrectly; see test_lexer.cpp update.
Differential Revision: [D73129443](https://our.internmc.facebook.com/intern/diff/D73129443/)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/151850
Approved by: https://github.com/Skylion007
ghstack dependencies: #151801, #151802, #151803, #151804, #151805, #151806, #151807, #151810, #151849
|
2025-04-25 23:49:35 +00:00 |
|
Scott Wolchok
|
cf101d66ee
|
Add simple direct C++ tests for torch::jit::Lexer (#151849)
We have test_jit.py, but given that I'm working on
significant changes to the lexer, it seems nice to have direct C++
tests. (Also, writing the tests caught a pair of related bugs; see the
two tests with "Bug" in their name. The rewrite will fix them.)
Differential Revision: [D73402367](https://our.internmc.facebook.com/intern/diff/D73402367/)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/151849
Approved by: https://github.com/malfet
ghstack dependencies: #151801, #151802, #151803, #151804, #151805, #151806, #151807, #151810
|
2025-04-25 22:39:49 +00:00 |
|