Project: ELLIE
A Meta-Synthesis of papers about English Language Education in Indonesia
Researcher’s Log
- 2026-08-29: Some links returned 403 Forbidden. Trying HTTP Header request forgery.
- 2026-08-28: Pseudocode for web scrapping
- 2026-08-27: Initial draft of research report
Found Problems
403 Forbidden on Some Websites
Lesson Learned: Some websites have security measures against bots or tools
I thought it would be appropriate for me to test whether all of the links that I have gathered are accessible. This is something that I learned from Cybersecurity courses. Manually visiting them were no problem. I could enter them just right. Things got tricky when I tried to access the journal websites using a tool (i.e., R using the httr2 package). Some of the links didn’t accept any tools or bots to access them. As a workaround (again, I learned this from Cybersecurity), I patched the HTTP Header request with custom headers. Below are the headers I tried along with the results.
| Header | Value | Outcome | Iteration |
|---|---|---|---|
N/A | N/A | Failed | 11/15 |
| User-Agent | “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:154.0) Gecko/20100101 Firefox/154.0” | Failed | 12/15 |
| Referer | ”” | x/x | |
| X-Origin-Site | ”” | x/x |