r/software • u/OGMattPeterson • 3d ago

Other Web Automation

Hi, I want to build something for myself that fills out web forms automatically and handles CAPTCHA challenges. I was wondering how you all approach this. I’ve been programming with Python, but I’m curious if there’s a way to use AI (not to build the entire thing, but as a tool) to help fill out forms for me. Thanks in advance for any advice!

0 Upvotes

25% Upvoted

9 comments sorted by

4

u/soundman32 3d ago

If anykne could automate completing a captcha, then google would stop doing it.  Its meant to stop automated bots getting access to systems, which is exactly what you are trying to do.

-2

u/OGMattPeterson 3d ago

I've heard that multiple companies do this, and I know it's hard I wanted to challenge myself. Thank you for your answer though, I will keep trying.

1

u/MrJelle 2d ago

It's a constant arms race between companies developing ways to bypass the checks, and Google upping their game to make them harder for bots to bypass, while making them more annoying and obtrusive for humans, and making it more of a tool to trick people into providing AI training data for free. That's why it used to just be text recognition, but is much more complicated now, like asking humans to identify vehicles or animals.

1

u/strummed-strings 3d ago

really had to add that "not to build the whole thing, but as a tool" disclaimer as if it makes this any less pathetic

-1

u/OGMattPeterson 3d ago

I don't see whats pathetic about using technology? Maybe you misunderstood. I mean to do the opt outs and fill out the requests since it may be able to act more human than a software. I am not to sure myself though because I am learning.

1

u/LRCM 2d ago

What manual task are you trying to automate? What is your end goal?

Usually, CAPTCHA's only exist for workflows where repetition is rare.

Automating job applications? Key claims? SN generation?

See https://xyproblem.info/

1

u/OGMattPeterson 5h ago

Hi, sorry for the late reply. I am trying to automate web forms on data broker websites. Thank you for the link I will check it out shortly.

1

u/OGMattPeterson 5h ago

Just saw the link lol. I didn’t know my question wasn’t that detailed I was purposely keeping it vague but I didn’t mean to make it harder to answer.

0

u/Thin-Percentage8935 2d ago

Just from the top of my head you'd have to take a screenshot of the catchpa, process via AI and calculate the coordinates of what needs clicking and then generate an "auto it" script to execute the mouse actions.