×
INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!
  • Students Click Here

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Any ideas how I can download a file from a web site that requires login mimicking clicks

Any ideas how I can download a file from a web site that requires login mimicking clicks

Any ideas how I can download a file from a web site that requires login mimicking clicks

(OP)
Hi everyone,

What I'm trying to do is (I'm hoping) rather straight forward. I want to download a CSV file from a website (the website generates the CSV) and process it with PHP. I know how to do the processing, but I can't figure out how to get it from the website.

In my browser I would do the following:
1) Browse to the login URL
2) Login with my email address and password (via web forms) and click the Login button.
3) I'm redirected to the dashboard where several tables load by AJAX. The first table has a CSV button I click.
4) A CSV is downloaded to my computer. However URL is kind of cryptic (blob:https://<website>/<random UID>)

Does anyone know how I can mimic these actions in PHP? Is it possible?

Thanks in advance!

RE: Any ideas how I can download a file from a web site that requires login mimicking clicks

Is this for some sort of unauthorized scraping or other exploit?

The web site publisher has likely set up this login process to prevent misuse of their content.

These login processes are employed because the site owner may want to trade your data or subscription payment for their data. The login process is most likely employed to prevent system resource abuse.

Instead of PHP, use TXT and send a message to the site's publisher to gain access to their data.

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Tek-Tips Forums free from inappropriate posts.
The Tek-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Tek-Tips forums is a member-only feature.

Click Here to join Tek-Tips and talk with other members! Already a Member? Login

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close