Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scrape fixing #4

Draft
wants to merge 82 commits into
base: main
Choose a base branch
from
Draft

Scrape fixing #4

wants to merge 82 commits into from

Conversation

AstrophysicsAndPython
Copy link
Collaborator

@AstrophysicsAndPython AstrophysicsAndPython commented Aug 2, 2022 •
edited
Loading

  • Added relative path option in __init__ method
  • Added static methods about add_import_to_results and add_from_results
  • Changed __scrape_import method
  • Changed __scrape_variables method
  • Added import_count method
  • Added option of all or top N most_used_variables
  • Separated imports in from_, import_, and all_ in get_import_names
  • Added more functionalities to utilities.py
  • Added test.py to .gitignore file

@AstrophysicsAndPython
[MAJOR-3]
f84e789 
* added relative path option in __init__ method
* added static methods about add_import_to_results and add_from_results
* changed __scrape_import method
* changed __scrape_variables method
* added import_count method
* added option of all or top N most_used_variables
* separated imports in from_, import_, and all_ in get_import_names
* added more functionalities to utilities.py
* added test.py to .gitignore file
@AstrophysicsAndPython AstrophysicsAndPython self-assigned this Aug 2, 2022
@AstrophysicsAndPython
Copy link
Collaborator Author

AstrophysicsAndPython commented Aug 2, 2022 •
edited
Loading

TODO

  • Fix the issue with import by using regex instead of string comparisons.

@DamnUi
Copy link
Owner

DamnUi commented Aug 3, 2022

Insane stuff man, looking over it right now its like a full revision

DamnUi and others added 12 commits August 7, 2022 20:17
@DamnUi @AstrophysicsAndPython
[MAJOR-1]
4b4444b 
[+]Added a new class called visual_wrapper which implements current code visually
[*]Get_import_count function needs work in the new class
[-]Removed some print lines in Stat class.
@DamnUi @AstrophysicsAndPython
[really minor1]
4db75f4
@DamnUi @AstrophysicsAndPython
[really-minor2]
5ffe74e
@DamnUi @AstrophysicsAndPython
kinda-MAJOR2
427f4e5
@DamnUi @AstrophysicsAndPython
[really-Minor-3]
167818b
@DamnUi @AstrophysicsAndPython
[Really-Minor-4]
ccca7b0
@DamnUi @AstrophysicsAndPython
[Really-Minor5]
9ea3094 
Centered quick stat completely
@DamnUi @AstrophysicsAndPython
[MINOR3]
0698ba0 
small changes to dashboard
@AstrophysicsAndPython
[MINOR-4]
93b9a05 
* made corrections in from_import and import_imports functions
@DamnUi @AstrophysicsAndPython
[MAJOR2]
3c7d37a 
[+] Added an adhd mode
@DamnUi @AstrophysicsAndPython
[MAJOR-3]
e3607bb 
[+] Added Extra adhd mode
[=] Better normal default colours
@DamnUi
[MINOR6?]
410bdfe 
Used black to format all the code looks cleaner now.
@AstrophysicsAndPython
Copy link
Collaborator Author

We messed up the MAJOR-MINOR thing good 😆

DamnUi and others added 8 commits August 8, 2022 15:54
@DamnUi
[MINOR-7]
35e693b 
Realized i made mistake and i skipped over [MINOR-5]
But i dont wanna fix it so here this is!
[+] Sorted Most Called Functions:
(Formatted this in the Stat class instead of VisualWrapper and that probably made it harder for me)
@DamnUi
[MINOR-8]
72dd7bf 
[+] Made count of import and from statements its own panels
(This time i actually made it easier for me and not be dumb and made the changes in the VisualWrapper class but it probably needed to be in this class
@DamnUi
[Really-MINOR-6]
abfaf0e 
[+] Added a rule line on line 494
@DamnUi
[Really-MINOR-7]
711a411 
[+] Not gonna explain
@DamnUi
[MINOR-9]
93342fa 
[+] Added a new parameter in command line options called --vars, supposed to be an int this will determine how many variables to get. (Astro take a look at line 397 i have implemented a temp fix but please implement a better fix as my code is giving me headache lol)

[+] Made all fetch statements Status statements

[=] I think line_count function parameter 2 (exclude_empty_line) is not working (line 199)
@DamnUi
Update PyStats.py
4ab372d
@DamnUi
[NEEDS TO BE HEAVILY REVISED I DONT KNOW WHAT SHIT I HAVE DONE]
877b80f 
please revise the get_import_count function in visualwrapper please
@AstrophysicsAndPython
[MINOR-10]
7bb0138 
* some major formatting corrections
* some minor function call and other corrections
@AstrophysicsAndPython
Copy link
Collaborator Author

AstrophysicsAndPython commented Aug 8, 2022 •
edited
Loading

  • Resolve issues with functions having an exact string in their names, for example, get_color and _color will give issues in counting.
  • Resolve issues with large number of files to be read, the list output for Selected Files is not okay

DamnUi and others added 30 commits August 22, 2022 18:09
@DamnUi
[Major-7]
12e4f34 
[+] Added a new panel which shows how many if, while, for, try and with statements exist

im not sure how to get the numbers coloured but if you want you can mess with it at line 638

[=] Now from and import modules are always the same height :)
[=] From import's are still not working properly
@DamnUi
[MINOR-21]
b85e38b 
[+] Fixed a few bugs
[+] Added a total variable count
@DamnUi
Update PyStats.py
b12dbea
@DamnUi
[MINOR-22]
897967c 
[+] Added a decorator count without ast using regex instead
@DamnUi
Update PyStats.py
285ce02
@DamnUi
[MINOR-23]
da27460 
[+] Fixed some bugs with Statements panel
@DamnUi
[]
7adbf02
@deepsource-autofix
Autofix issues in 5 files
f52085c 
Resolved issues in the following files via DeepSource Autofix:
1. All current dashboard ideas.py/revision design.py
2. checks.py
3. gex/func and class.py
4. PyStats.py
5. utilities.py
@DamnUi
Delete checks.py
fa43cd9
@DamnUi
Merge branch 'scrap-dev2' of https://github.com/DamnUi/PyStats into s…
625d941 
…crap-dev2
@DamnUi
[MINOR-24]
1db06b8 
[=] Changed some existing code so it improves performance
- removed unused var
- useless lines
@norbcodes
Fixed typos
b864ae1
@DamnUi
Merge pull request #9 from norbcodes/scrap_dev2
4a4d581 
Fixed typos
@DamnUi
Revert "Fixed typos"
d40a25c
@DamnUi
Merge pull request #10 from DamnUi/revert-9-scrap_dev2
67fa8c9 
Revert "Fixed typos"
@DamnUi
[MINOR-25]
839922e 
[+] Fixed a bug with a try statement count fixed it by rounding up also fixed an error with functions showing 1 less (defined line)
@DamnUi
Merge branch 'scrap-dev2' of https://github.com/DamnUi/PyStats into s…
afa2ba9 
…crap-dev2
@AstrophysicsAndPython
[MINOR-24]
03f0f9b 
* major code reformatting and minor spellings corrections
* code cleanup and variable naming
* partially consistent color scheme for the dashboard
@DamnUi
Merge branch 'scrap-dev2' of https://github.com/DamnUi/PyStats into s…
b584ce1 
…crap-dev2
@DamnUi
[maybe-MAJOR-8]
9d22614 
these are rare
[+] Added an img view option --imgpath which displays an img
@DamnUi
[MINOR-25]
8dbfe89 
i did something
@DamnUi
[MINR-26]
e8dbe9f 
Did something now i have brain dmg
@DamnUi
[MINOR-27]
0c6b0ef 
probably spent like 6hrs today on python
[=] Massively improved quick stats
@AstrophysicsAndPython
[MINOR-28]
55f4246 
* major code reformatting and minor spellings corrections
* code cleanup and variable naming
* partially consistent color scheme for the dashboard
@AstrophysicsAndPython
[MAJOR-9]
a2caecd 
* moved the Stats and VisualWrapper from PyStats.py to _PyStats.py file so that the main file is cleaner
* some minor changes in _PyStats.py
@AstrophysicsAndPython
[MINOR-29]
c4bc01b 
* got PyStats.py working again properly
@DamnUi
[MINOR-28]
b3be98e 
minor stuff totally did not take me hrs
@AstrophysicsAndPython
[MINOR-30]
7b03ca5 
* some minor fixes, the variable count is still whack
@AstrophysicsAndPython
[MAJOR-10]
4c27676 
* added the table format and some fixes
@DamnUi
Update README.md
2bffc8f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@DamnUi DamnUi Awaiting requested review from DamnUi

Assignees

@AstrophysicsAndPython AstrophysicsAndPython

Labels
enhancement New feature or request import_scrapping variable_scrapping
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@AstrophysicsAndPython @DamnUi @norbcodes