All Questions
Tagged with web-scraping c#
779
questions
0
votes
0
answers
14
views
Selenium accordion element to be clickable
I have the following HTML code:
<spaui-accordion _ngcontent-ouh-c26="">
<spaui-accordion-tab _ngcontent-ouh-c26="" id="accordioAcordosPendentes&...
- 37
0
votes
1
answer
35
views
Click on a Selenium button that isn't an input
I've the following HTML code:
<div _ngcontent-fsi-c26="" class="col-xs-12 ng-star-inserted" style="margin-top: 3%;">
<div _ngcontent-...
- 37
0
votes
0
answers
45
views
Data Scraping C# Using Selenium Looking for a Accurate Better Code for this
How do i increment the data which has a [@id="app"]/article/div/div[4]/div[2]/div[1]/ol/li[1]/div -- li[1] <-- increment each foreach so the data doesnot duplicate from the 1st row list ...
1
vote
1
answer
36
views
How can I properly scrape the VISA Currency page when there's a Shadow-Root layer above the input fields?
I've been trying to automatically populate the VISA currency calculator page to calculate the exchange rate. Unfortunately, I'm having trouble accessing the fields because it seems there's a Shadow-...
- 11
0
votes
0
answers
33
views
Programmatically read data / click links / download files from webpage?
I'm looking for a way to programmatically read text / click links (which downloads files) from a webpage, preferably with C# but really any solution is fine as long as it works on Windows.
Some ...
- 5,073
0
votes
0
answers
24
views
.NET Web Scraping works in Console Application but not in Api Application [duplicate]
I want to get the html content result from a search executed on amazon (e.g. Example link).
My applications runs on localhost.
When I start an .NET Console Application the result ist correct (html ...
- 565
1
vote
0
answers
52
views
.Net Scraping Wordpress website 429 too many request
I would like my users to add website links and retreive metadata from it.
For exemple, title, description, og:image, etc...
I used WebClient or HttpClient to first retrive the HTML content.
Then I ...
- 11
0
votes
0
answers
36
views
is there any method or webhook to get message response or message data from the telegram channel in c# without any use of bot?
i want to get message details and the message texts from the telegram channel. i have read and go through many solutions but didn't get result or answer i need. most of them are using bot but i want ...
0
votes
1
answer
124
views
WebClient return 403 when trying to use DownloadFile()
I am starting web scrapper and wanted to scrape something i might use once.
As an example i want to scrape this image (https://thebarchive.com/b/full_image/1707085883033680.jpg)
using WC DownloadFile ...
1
vote
0
answers
95
views
C# Web Scraping with HTMLAgilityPack, can't move to the next page?
I have a program that can successfully login and can receive cookies. However, I've noticed when I try to move to the next page after logging in, the HTML isn't changing. So I'm assuming that I haven'...
- 19
1
vote
1
answer
194
views
Getting 403 error in non-public API but not blocked from domain
I hope everything is good with you!
I created a tool in C# that would run every day and was able to fetch me the prices of all the products in certain categories of my choice from the Cex website (uk....
- 13
-1
votes
2
answers
91
views
How can I download this site with WebClient of .NET?
I cannot download this site: https://verify.sos.ga.gov/verification/Search.aspx by using WebClient of .NET; during download process, I get Forbidden error. My code is like this: I first go to the ...
1
vote
2
answers
725
views
How to Disable WEB USB Flag in ChromeDriver Selenium in C#?
Error:
[3528:3760:0205/072321.889:ERROR:device_event_log_impl.cc(192)] [07:23:21.489] USB: usb_service_win.cc:105 SetupDiGetDeviceProperty({{A45C254E-DF1C-4EFD-8020-67D146A850E0}, 6}) failed: Element ...
- 681
0
votes
0
answers
75
views
C# PuppeteerSharp Redirection from Cloudflare Waiting Room is blocked
The site I'm trying to explore with Puppeteer is protected by a Cloudflare page that analyzes the browser. It appears that there is some problem when using GoToAsync - the Cloudflare waiting room is ...
- 79
0
votes
0
answers
39
views
Submitting File Upload Form with C#
I am trying to automate/webscrape a process that we have internally to a third party website, but I am getting stuck on the forms onChange event.
The form that I have to post to has an element like ...
- 885