Date   

Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

 

Hi,

I see. In this case, would you like to talk to the author of this add-on (unless you already talked to the author) to get some advice and early feedback? If yes, I’ll forward this conversation to NVDA add-ons list.

Cheers,

Joseph

 

From: nvda-devel@groups.io <nvda-devel@groups.io> On Behalf Of Shubham Jain
Sent: Thursday, May 7, 2020 10:41 AM
To: nvda-devel@groups.io
Subject: Re: [nvda-devel] Introducing our Google Summer of Code 2020 student: Shubham Jain

 

Hello Joseph!

Image Describer is a big inspiration for this project.


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Shubham Jain
 

Hello Joseph!

Image Describer is a big inspiration for this project.


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Shubham Jain
 

Hi Pawel!

Yes, chrome already supports getting image descriptions and it is amazing! Given the amount of resources companies like Google has at their disposal, it is impossible for our models to be as good but I think it is a step in the right direction. We can always improve any implementation in the future when computation is easier. Besides, it is always best to not rely on 3rd party services as their terms might change. With an inbuilt implementation, we can provide this function in not just chrome but other browsers  and with local photo-viewing apps!


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

 

Hi,
Image Describer used to be a useful NVDA add-on for this purpose until things changed.
Cheers,
Joseph

-----Original Message-----
From: nvda-devel@groups.io <nvda-devel@groups.io> On Behalf Of Pawel Urbanski
Sent: Thursday, May 7, 2020 7:05 AM
To: nvda-devel@groups.io
Subject: Re: [nvda-devel] Introducing our Google Summer of Code 2020 student: Shubham Jain

If only Chrome did not have this feature already. You just tell it to automatically get descriptions for images that have no alt attribute specified...


On 07/05/2020, enes sarıbaş <enes.saribas@...> wrote:
Hello Shubham,

Even a few cases I believe could possibly cover all or most of the
capchas outside of google with no audio. Therefore, I believe this
would make the lives of NVDA users even better with such a feature.

I wish you the best on your project

Enes

On 5/7/2020 1:47 AM, Shubham Jain wrote:
Hello Enes,

Thank you for your interest in my project!
There has been a lot of research and work on solving captchas using
ML techniques and it is certainly possible. However, these models are
specific to the types of captchas they have been trained on and will
not work with other types. I understand that having it work in only a
few specific cases is still a big advantage. Hopefully, Google's
Captcha v3 will do away with this problem entirely, as it does not
rely on any explicit user input.
Yours is a brilliant idea nonetheless and definitely one to look into!

regards,
Shubham Jain



Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Pawel Urbanski
 

If only Chrome did not have this feature already. You just tell it to
automatically get descriptions for images that have no alt attribute
specified...

On 07/05/2020, enes sarıbaş <enes.saribas@...> wrote:
Hello Shubham,

Even a few cases I believe could possibly cover all or most of the
capchas outside of google with no audio. Therefore, I believe this would
make the lives of NVDA users even better with such a feature.

I wish you the best on your project

Enes

On 5/7/2020 1:47 AM, Shubham Jain wrote:
Hello Enes,

Thank you for your interest in my project!
There has been a lot of research and work on solving captchas using ML
techniques and it is certainly possible. However, these models are
specific to the types of captchas they have been trained on and will
not work with other types. I understand that having it work in only a
few specific cases is still a big advantage. Hopefully, Google's
Captcha v3 will do away with this problem entirely, as it does not
rely on any explicit user input.
Yours is a brilliant idea nonetheless and definitely one to look into!

regards,
Shubham Jain



Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

enes sarıbaş
 

Hello Shubham,

Even a few cases I believe could possibly cover all or most of the capchas outside of google with no audio. Therefore, I believe this would make the lives of NVDA users even better with such a feature.

I wish you the best on your project

Enes

On 5/7/2020 1:47 AM, Shubham Jain wrote:
Hello Enes,

Thank you for your interest in my project!
There has been a lot of research and work on solving captchas using ML techniques and it is certainly possible. However, these models are specific to the types of captchas they have been trained on and will not work with other types. I understand that having it work in only a few specific cases is still a big advantage. Hopefully, Google's Captcha v3 will do away with this problem entirely, as it does not rely on any explicit user input.
Yours is a brilliant idea nonetheless and definitely one to look into!

regards,
Shubham Jain


NVDA 2020.1 now released

Reef Turner
 

Hello everyone,

NVDA 2020.1 stable has just been released. See the full post at: https://www.nvaccess.org/post/nvda-2020-1-released/
Thank you for all your contributions. The community is what makes NVDA what it is.

Reef (NV Access)


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Shubham Jain
 

Hello Enes,

Thank you for your interest in my project!
There has been a lot of research and work on solving captchas using ML techniques and it is certainly possible. However, these models are specific to the types of captchas they have been trained on and will not work with other types. I understand that having it work in only a few specific cases is still a big advantage. Hopefully, Google's Captcha v3 will do away with this problem entirely, as it does not rely on any explicit user input.
Yours is a brilliant idea nonetheless and definitely one to look into!

regards,
Shubham Jain


Re: NumLock state makes me crazy

Cyrille
 

Hi Karl-Otto

1. Do you use Windows Magnifier add-on? If yes, please download this version: winMag-1.0-dev-20200306.nvda-addon on my Github repo; it fixes such an issue. Note that I did not yet ask to update the version on the community web site because there are still bugs to investigate and fix.

2. Did you map (yourself or thanks to an add-on) a gesture involving numpad when numlock is active? If yes and if the script called by this gesture calls gesture.send(), this may be the cause of the issue. See the following NVDA issue  for more details: Using gesture.send deactivates unwantedly NumLock #10827.

Cheers,


Cyrille


Le 06/05/2020 à 22:10, Karl-Otto Rosenqvist a écrit :
Hi!
I'm not sure why my NumLock is getting turned off quite often. I know that I'm not doing it and I haven't had this problem earlier.
I can't find any setting in NVDA that has anything with NumLock to do.

Is there a new behavior in the alphas that I'm not aware of?


Cheers

Karl-Otto



NumLock state makes me crazy

Karl-Otto Rosenqvist
 

Hi!
I'm not sure why my NumLock is getting turned off quite often. I know that I'm not doing it and I haven't had this problem earlier.
I can't find any setting in NVDA that has anything with NumLock to do.

Is there a new behavior in the alphas that I'm not aware of?


Cheers

Karl-Otto


--
Karl-Otto Rosenqvist
MAWINGU
Orgnr: 750804-3937
0701- 75 98 56
karl-otto@...
https://mawingu.se


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

enes sarıbaş
 

Hello Shubham,

Your project is very interesting, and will be a game changer for NVDA users' access to information. I apologize if I am too overeager, but I would like to know if such an image recognition system could be utilized to solve capchas  that cannot be solved due to the inavailability of audio cues.


On 5/5/2020 2:00 PM, shubhamdjain7@... wrote:
Hello Noelia!

I am glad that you find my project interesting :)
It will certainly be a challenge to detect all images and generate useful and correct descriptions for them on browsers. I wish that this project will be useful and comfortable to use, just like the existing features.
The links you have shared are very helpful, thank you so much!

Looking forward to more collaboration with you.

regards,
Shubham Jain


Re: [nvda-addons] [nvda-devel] Add-on Template: latest happenings

Noelia Ruiz
 

Hi Luke, really I am talking about much more: I managed to use
appveyor in add-ons thanks to Abdel. Other people tried it too.
Anyway, my first successful experience was when Abdel developed an
functional appveyor file to be use in conjunction with add-on
template. He also added fixes in sconstruct to fix an issue produced
in documentation due to translations. Also, he uses appveyor even for
ftp, not just for GitHub.
Now I like a lot GitHub Actions and Mesar worked a lot creating
functional GitHub Actions which can download an executable for NVDA an
install it, so that eventually add-ons may be tested if needed in
GitHub servers. I worked with Mesar experimenting with Actions and he
is a super-developer with lot of skills.
I will wait for the future add-on store if finally becomes a reality,
since I think that each of us uses a version of sconstruct, appveyor,
Actions and so on, so maybe easier to know if a unified way is
preferred.
I wrote a tutorial for using GitHub Actions and to be notified about
add-ons commit using Google services in the wiki:
https://github.com/nvdaaddons/nvdaaddons.github.io/wiki

Actions for experimenting (by Mesar and me) are at
https://github.com/nvdaaddons/l10ntest
All this maybe included in addonTemplate.

2020-05-06 0:26 GMT+02:00, Luke Davis <luke@...>:

On Tue, 5 May 2020, Noelia Ruiz wrote:

Also Abdel
made great contributions to appveyor.
Are you talking here about his additions to your wiki page about Appveyor?

If so, I agree, well done, both of you, for putting that together.

https://github.com/nvdaaddons/nvdaaddons.github.io/wiki/appveyor

It may need some slight updates for Python 3.7 however. I will send
something.

Luke





Re: [nvda-addons] [nvda-devel] Add-on Template: latest happenings

Luke Davis
 

On Tue, 5 May 2020, Noelia Ruiz wrote:

Also Abdel
made great contributions to appveyor.
Are you talking here about his additions to your wiki page about Appveyor?

If so, I agree, well done, both of you, for putting that together.

https://github.com/nvdaaddons/nvdaaddons.github.io/wiki/appveyor

It may need some slight updates for Python 3.7 however. I will send something.

Luke


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Shubham Jain
 

Hello Noelia!

I am glad that you find my project interesting :)
It will certainly be a challenge to detect all images and generate useful and correct descriptions for them on browsers. I wish that this project will be useful and comfortable to use, just like the existing features.
The links you have shared are very helpful, thank you so much!

Looking forward to more collaboration with you.

regards,
Shubham Jain


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Shubham Jain
 

Thank you for the introduction Reef!

I am very excited to be working on this project and getting to know the community better! As Reef mentioned, you can find details about the project at the above link or you can just contact me.

The ultimate goal of this project is to help and benefit the community and users, and so, I would love any and all feedback, tips and guidance you might have to offer!
It will not be possible for this project to be a success without your input!

Looking forward to working with all of you!

regards,
Shubham Jain


Re: Add-on Template: latest happenings

 

Hi,

Don’t worry – Flake8 tests isn’t mandatory.

Cheers,

Joseph

 

From: nvda-devel@groups.io <nvda-devel@groups.io> On Behalf Of Andy B.
Sent: Tuesday, May 5, 2020 4:56 AM
To: nvda-devel@groups.io
Subject: Re: [nvda-devel] Add-on Template: latest happenings

 

It doesn’t look like Developer toolkit will opt into flake8 anytime soon. I have features that take priority over formatting styles right now.

 

 

Sent from Mail for Windows 10

 

From: Joseph Lee
Sent: Tuesday, May 5, 2020 4:19 AM
To: nvda-addons@nvda-addons.groups.io
Subject: [nvda-devel] Add-on Template: latest happenings

 

Hi all,

 

Some important edits were made to community add-on template (source code: https://github.com/nvdaaddons/addonTemplate), mostly dealing with sconstruct file:

 

  • Custom versions and add-on documentation: previously when generating add-on documentation from command line tools, a custom version specified from command line would not be applied to add-on documentation. This has been fixed.
  • Add-on documentation: now generates HTML5 (credit: Noelia Martinez).

 

Also, some parts of add-on template will be subject to Flake8 tests/edits (mostly sconstruct), and hopefully modernizing sconstruct in the process. I don’t expect add-ons to use the new sconstruct, but I highly encourage you to update add-on source code based on latest happenings with the community add-on template to add uniformity.

Cheers,

Joseph

 


Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Noelia Ruiz
 

Hello Shubham, I am a spanish user of NVDA and your project is really
interesting. Imo, NVDA's interface (the possibility of using
customized gestures to display messages in different ways like braille
and speech) is comfortable and useful, and knowing the meaning of
images is very important. Of course they should be described by people
in most cases.
Imo a possible challenge maybe the possibility to detect images
without an alt text so that we can request them to be described via
NVDA.
I followed a course about web accessibility recommended by Quentin in
the In-Process blog of NV Access and there I learned about Wave, an
extension for web browsers which can report the presence of images not
detected by screen readers (when they don't have an alternative text):
https://wave.webaim.org/extension/

I had this difficulty using a wonderful add-on created time ago (not
maintained as far as I know) by Larry Wang:
https://addons.nvda-project.org/addons/onlineOCR.en.html
Hope you enjoy and thanks for your interest in these projects.

2020-05-05 17:44 GMT+02:00, Reef Turner <reef@...>:

Hi all,

On behalf of NV Access I would like to officially welcome Shubham Jain to
the NVDA project, as our Google Summer of Code 2020 student.

Between now and the end of August, Shubham will be working on "Image
captioning and Object recognition modules for NVDA".  You can read about NV
Access on Google Summer of Code, and Shubham's project abstract at
https://summerofcode.withgoogle.com/projects/#6039693356957696 (
https://summerofcode.withgoogle.com/projects/#6039693356957696 )

Please join me in making Shubham welcome!

Regards,
Reef.




Re: Introducing our Google Summer of Code 2020 student: Shubham Jain

Akash Kakkar
 

Welcome Shubham.

On 5/5/20, Reef Turner <reef@...> wrote:
Hi all,

On behalf of NV Access I would like to officially welcome Shubham Jain to
the NVDA project, as our Google Summer of Code 2020 student.

Between now and the end of August, Shubham will be working on "Image
captioning and Object recognition modules for NVDA".  You can read about NV
Access on Google Summer of Code, and Shubham's project abstract at
https://summerofcode.withgoogle.com/projects/#6039693356957696 (
https://summerofcode.withgoogle.com/projects/#6039693356957696 )

Please join me in making Shubham welcome!

Regards,
Reef.




Introducing our Google Summer of Code 2020 student: Shubham Jain

Reef Turner
 

Hi all,

On behalf of NV Access I would like to officially welcome Shubham Jain to the NVDA project, as our Google Summer of Code 2020 student.

Between now and the end of August, Shubham will be working on "Image captioning and Object recognition modules for NVDA".  You can read about NV Access on Google Summer of Code, and Shubham's project abstract at https://summerofcode.withgoogle.com/projects/#6039693356957696

Please join me in making Shubham welcome!

Regards,
Reef.


Re: Add-on Template: latest happenings

Noelia Ruiz
 

Hi, though I prefer not to make cross posting, since this is sent to
the dev and add-ons list, I will reply to all.

- I have approved a pull request from Julien reverting background and
text color in stylesheet). I want to say thanks to Chris Leo, main
author of emoticons, contributor of eSpeak NG with great contribution
for spanish community, reviewer of add-ons like reportPasswords, part
of the translation team for Italian and contributor as an author of
placeMarkers and eMule add-ons.
He contributed a stylesheet created in spanish community, where we
posted add-ons before this international list was created.
Add-on template could also benefit from Mesar's contributions (we
worked on GitHub Actions and he created an action to check if add-ons
are or not using the latest version of addon template). Also Abdel
made great contributions to appveyor. I think add-on template should
be uniformized according with the expected future add-on workflow.
Cheers

2020-05-05 10:19 GMT+02:00, Joseph Lee <@joslee>:

Hi all,



Some important edits were made to community add-on template (source code:
https://github.com/nvdaaddons/addonTemplate), mostly dealing with
sconstruct
file:



* Custom versions and add-on documentation: previously when generating
add-on documentation from command line tools, a custom version specified
from command line would not be applied to add-on documentation. This has
been fixed.
* Add-on documentation: now generates HTML5 (credit: Noelia Martinez).



Also, some parts of add-on template will be subject to Flake8 tests/edits
(mostly sconstruct), and hopefully modernizing sconstruct in the process. I
don't expect add-ons to use the new sconstruct, but I highly encourage you
to update add-on source code based on latest happenings with the community
add-on template to add uniformity.

Cheers,

Joseph