Difference between revisions of "User:DavidB4-bot/HTTPS URL update project"
(+1) |
|||
| (27 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<small>(originally moved from [[User talk:DavidB4]])</small> | <small>(originally moved from [[User talk:DavidB4]])</small> | ||
| − | The Web is changing a great deal. One of these changes is the shift from the [[HyperText Transfer Protocol]] to [[HyperText Transfer Protocol Secure]]. While HTTPS is not perfect (and it will continue to be less | + | The Web is changing a great deal. One of these changes is the shift from the [[HyperText Transfer Protocol]] to [[HyperText Transfer Protocol Secure]]. While HTTPS is not perfect (and it will continue to be less than ideal at least until/unless we get DNSSEC) this is a good move. The problem for us is that we now have a great deal of links which are out of date. 1990'sguy pointed out this issue and suggested that I use my bot to update our links. I don't have the ability to automatically test URLs for TLS support, so I'm making a list of URLs to be updated. Please add any links you want updated to the "[[User:DavidB4-bot/HTTPS URL update project#New entries|New entries]]" section below, with one on each line in the page editor. Thank you! |
| − | == | + | ==URLs== |
===New entries=== | ===New entries=== | ||
'''Please place new URLs to be updated here''' ''Note: don't worry about using break tags, so entries show on the same line. Just give each one a new line in the editor, and I'll do the rest.''<br /> | '''Please place new URLs to be updated here''' ''Note: don't worry about using break tags, so entries show on the same line. Just give each one a new line in the editor, and I'll do the rest.''<br /> | ||
| + | encyclopediaofarkansas.net | ||
| + | www.ruebelfuneralhome.com | ||
| + | www.findagrave.com | ||
| + | www.sos.arkansas.gov | ||
| + | www.arkansas.gov | ||
| + | forbes.com | ||
| + | www.boxofficemojo.com | ||
| + | |||
| + | ===Verified, not processed=== | ||
| + | https://www.thecabin.net/ | ||
| + | https://www.nga.org/ | ||
| + | |||
| + | ===Failed verification=== | ||
| + | ''These do not seem to fully support HTTPS. They will probably be checked again, periodically.''<br /> | ||
| + | https://www.snopes.com | ||
| + | https://www.keynesatharvard.org (parital support, none enforced) | ||
| + | https://clerk.house.gov (breaks some links, such as clerk.house.gov/evs/2010/roll638.xml) | ||
| + | https://optionline.org | ||
| + | https://legacy.lib.utexas.edu | ||
| + | https://www.post-gazette.com | ||
| + | https://www.silentnomoreawareness.org | ||
| + | https://www.jpands.org | ||
| + | https://www.theunchoice.com | ||
| + | https://www.ewtn.com | ||
| + | |||
| + | ===Done=== | ||
| + | ====run 3==== | ||
https://www.nationalreview.com | https://www.nationalreview.com | ||
https://www.realclearmarkets.com | https://www.realclearmarkets.com | ||
| Line 23: | Line 50: | ||
https://www.forbes.com | https://www.forbes.com | ||
https://www.vanityfair.com | https://www.vanityfair.com | ||
| − | |||
https://www.law.uchicago.edu | https://www.law.uchicago.edu | ||
https://www.wsj.com | https://www.wsj.com | ||
| − | |||
https://vault.fbi.gov | https://vault.fbi.gov | ||
| − | |||
| − | |||
https://www.houstonpress.com | https://www.houstonpress.com | ||
https://www.pbs.org | https://www.pbs.org | ||
https://www.linkedin.com | https://www.linkedin.com | ||
https://illinoistimes.com | https://illinoistimes.com | ||
| − | |||
https://www.mail-archive.com | https://www.mail-archive.com | ||
| − | |||
https://www.govtrack.us | https://www.govtrack.us | ||
https://www.nbcnews.com | https://www.nbcnews.com | ||
| Line 51: | Line 72: | ||
https://thecaucus.blogs.nytimes.com | https://thecaucus.blogs.nytimes.com | ||
https://www.nytimes.com | https://www.nytimes.com | ||
| − | + | https://abcnews.go.com | |
| − | + | https://www.mcclatchydc.com | |
| − | + | https://obamawhitehouse.archives.gov | |
| − | + | https://www.people-press.org | |
| − | + | https://www.pewresearch.org | |
| − | + | https://transition.fec.gov | |
| − | + | https://www.fec.gov | |
| + | https://fred.stlouisfed.org | ||
| + | https://www.stlouisfed.org | ||
| + | https://www.cbo.gov | ||
| + | https://data.bls.gov | ||
| + | https://www.bls.gov | ||
| + | https://slate.com | ||
| + | https://seekingalpha.com | ||
| + | https://www.republican.senate.gov | ||
| + | https://www.amazon.com | ||
| + | https://www.congress.gov | ||
| + | https://www.washingtonpost.com | ||
| + | https://www.businessinsider.com | ||
| + | https://www.standardandpoors.com | ||
| + | https://www.census.gov | ||
| + | https://www.nabe.com | ||
| + | https://www.dailysignal.com | ||
| + | https://townhall.com | ||
| + | https://www.whitehouse.gov | ||
| + | https://krugman.blogs.nytimes.com | ||
| + | https://legalblogs.findlaw.com | ||
| + | https://www.wnyc.org | ||
| + | https://www.theguardian.com | ||
| + | https://pierrelemieux.com | ||
| + | https://womensenews.org | ||
| + | https://illinoisreview.typepad.com | ||
| + | https://www.typepad.com | ||
| + | https://www.express.co.uk | ||
| + | https://www.hrw.org | ||
| + | https://fas.org | ||
| + | https://articles.boston.com | ||
| + | https://www.salon.com | ||
| + | https://www.westernjournal.com | ||
| + | https://www.timesofisrael.com | ||
| + | https://www.itworldcanada.com | ||
| + | https://www.presstv.com | ||
| + | https://www.yahoo.com | ||
| + | https://politicalhumor.about.com | ||
| + | https://insider.foxnews.com | ||
| + | https://www.weeklystandard.com | ||
| + | https://www.ucsb.edu | ||
| + | https://www.archives.gov | ||
| + | https://www.utexas.edu | ||
| + | https://www.washingtontimes.com | ||
| + | https://www.aier.org | ||
| + | https://www.tampabay.com | ||
| + | https://womenintheworld.com | ||
| + | https://www.channel3000.com | ||
| + | https://www.westernmastery.com | ||
| + | https://christianliferesources.com | ||
| + | https://www.limaohio.com | ||
| + | https://www.guttmacher.org | ||
| + | https://www.hli.org | ||
| + | https://academic.oup.com | ||
| + | https://www.ncbi.nlm.nih.gov | ||
| + | https://www.cdc.gov | ||
| + | https://www.thetimes.co.uk | ||
| + | https://www.thinkingchristian.net | ||
| + | https://jme.bmj.com | ||
| + | https://evolutionnews.org | ||
| + | https://www.abortionfacts.com | ||
| + | https://www.leagle.com | ||
| + | https://caselaw.findlaw.com | ||
| + | https://www.abortionno.org | ||
| + | https://www.bbc.com | ||
| + | https://www.liveaction.org | ||
| + | https://www.thejournal.ie | ||
| + | https://godparent.org | ||
| + | https://www.plannedparenthood.org | ||
| + | https://prochoice.org | ||
| + | https://www.rebelmouse.com | ||
| + | https://www.citizenreviewonline.org | ||
| + | https://ftw.usatoday.com | ||
==Old entries== | ==Old entries== | ||
| Line 262: | Line 355: | ||
|https://accuweather.com|| Y || Y #1 | |https://accuweather.com|| Y || Y #1 | ||
|- | |- | ||
| − | |http://washingtonexaminer.com|| Y || | + | |http://washingtonexaminer.com|| Y || N? |
|- | |- | ||
| − | |https://www.washingtonexaminer.com || Y || | + | |https://www.washingtonexaminer.com || Y || N? |
|- | |- | ||
|https://www.haaretz.com|| Y || Y #2 | |https://www.haaretz.com|| Y || Y #2 | ||
| Line 336: | Line 429: | ||
|https://www.heritage.org || Y || Y #2 | |https://www.heritage.org || Y || Y #2 | ||
|- | |- | ||
| − | |https://www.sandiegouniontribune.com || Y || | + | |https://www.sandiegouniontribune.com || Y || Y #3 |
| + | |- | ||
| + | |https://www.timesofisrael.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.jpost.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.icr.org || Y || Y #3 | ||
| + | |- | ||
| + | |https://creation.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.conservativereview.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.theamericanconservative.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://cis.org || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.cis.org || Y || Y #3 | ||
| + | |- | ||
| + | |https://arxiv.org || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.gotquestions.org/ || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.nbcnews.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.cnbc.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.voanews.com || Y || Y #3 | ||
| + | |- | ||
| + | |https://www.congress.gov || Y || Y #3 | ||
|- | |- | ||
| − | |https://www. | + | |https://www.dallasnews.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.mcclatchydc.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.apnews.com || Y || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://www.govexec.com || Y || Y #3 || An odd tracking method redirects visitors to https://cdn.govexec.com/ before being again redirected to https://www.govexec.com. cdn.govexec.com is not fully secure. |
|- | |- | ||
| − | |https://www. | + | |https://www.oann.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.reviewjournal.com || Y || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://www.latimes.com || Y || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://chicagotribune.com || Y || Y #3 || This site barely works anyway, so changing it to HTTPS shouldn't break anything... |
|- | |- | ||
| − | |https:// | + | |https://www.npr.org || Y || Y #3 || Duplicated entry |
|- | |- | ||
| − | |https://www. | + | |https://www.billoreilly.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.hollywoodreporter.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.idahostatesman.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.gq-magazine.co.uk || Y || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://observer.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.seattletimes.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.kentucky.com || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.nationalmemo.com || Y || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://fortune.com || F || Y #3 |
|- | |- | ||
| − | |https:// | + | |https://timesofindia.indiatimes.com || Y || Y #3 |
|- | |- | ||
| − | | | + | |https://www.mirror.co.uk || Y || Y #3 |
|- | |- | ||
| − | |https://www. | + | |https://www.marketwatch.com || Y || Y #3 |
|- | |- | ||
| − | | | + | |https://www.infowars.com || F || N || Seems to intermittently load HTTP content, thus potentially causing issues for a certain browser owned by Google |
|} | |} | ||
| Line 396: | Line 517: | ||
# completed 9/26/2018 | # completed 9/26/2018 | ||
# completed 4/3/2019 (1738 edits) | # completed 4/3/2019 (1738 edits) | ||
| + | # completed 4/10/2019 (4343 edits) | ||
Latest revision as of 23:00, April 23, 2021
(originally moved from User talk:DavidB4)
The Web is changing a great deal. One of these changes is the shift from the HyperText Transfer Protocol to HyperText Transfer Protocol Secure. While HTTPS is not perfect (and it will continue to be less than ideal at least until/unless we get DNSSEC) this is a good move. The problem for us is that we now have a great deal of links which are out of date. 1990'sguy pointed out this issue and suggested that I use my bot to update our links. I don't have the ability to automatically test URLs for TLS support, so I'm making a list of URLs to be updated. Please add any links you want updated to the "New entries" section below, with one on each line in the page editor. Thank you!
URLs
New entries
Please place new URLs to be updated here Note: don't worry about using break tags, so entries show on the same line. Just give each one a new line in the editor, and I'll do the rest.
encyclopediaofarkansas.net
www.ruebelfuneralhome.com
www.findagrave.com
www.sos.arkansas.gov
www.arkansas.gov
forbes.com
www.boxofficemojo.com
Verified, not processed
https://www.thecabin.net/ https://www.nga.org/
Failed verification
These do not seem to fully support HTTPS. They will probably be checked again, periodically.
https://www.snopes.com
https://www.keynesatharvard.org (parital support, none enforced)
https://clerk.house.gov (breaks some links, such as clerk.house.gov/evs/2010/roll638.xml)
https://optionline.org
https://legacy.lib.utexas.edu
https://www.post-gazette.com
https://www.silentnomoreawareness.org
https://www.jpands.org
https://www.theunchoice.com
https://www.ewtn.com
Done
run 3
https://www.nationalreview.com https://www.realclearmarkets.com https://www.sba-list.org https://www.msn.com https://www.ssa.gov https://www.staradvertiser.com https://www.axs.com https://web.archive.org https://www.scribd.com https://www.csmonitor.com https://graphics8.nytimes.com https://www.foxnews.com https://www.factcheck.org https://blogs.wsj.com https://www.forbes.com https://www.vanityfair.com https://www.law.uchicago.edu https://www.wsj.com https://vault.fbi.gov https://www.houstonpress.com https://www.pbs.org https://www.linkedin.com https://illinoistimes.com https://www.mail-archive.com https://www.govtrack.us https://www.nbcnews.com https://edition.cnn.com https://www.opensecrets.org https://votesmart.org https://www.investmentnews.com https://www.politifact.com https://www.nysun.com https://www.presidency.ucsb.edu https://www.thetimes.co.uk https://www.usnews.com https://www.nrlc.org https://thecaucus.blogs.nytimes.com https://www.nytimes.com https://abcnews.go.com https://www.mcclatchydc.com https://obamawhitehouse.archives.gov https://www.people-press.org https://www.pewresearch.org https://transition.fec.gov https://www.fec.gov https://fred.stlouisfed.org https://www.stlouisfed.org https://www.cbo.gov https://data.bls.gov https://www.bls.gov https://slate.com https://seekingalpha.com https://www.republican.senate.gov https://www.amazon.com https://www.congress.gov https://www.washingtonpost.com https://www.businessinsider.com https://www.standardandpoors.com https://www.census.gov https://www.nabe.com https://www.dailysignal.com https://townhall.com https://www.whitehouse.gov https://krugman.blogs.nytimes.com https://legalblogs.findlaw.com https://www.wnyc.org https://www.theguardian.com https://pierrelemieux.com https://womensenews.org https://illinoisreview.typepad.com https://www.typepad.com https://www.express.co.uk https://www.hrw.org https://fas.org https://articles.boston.com https://www.salon.com https://www.westernjournal.com https://www.timesofisrael.com https://www.itworldcanada.com https://www.presstv.com https://www.yahoo.com https://politicalhumor.about.com https://insider.foxnews.com https://www.weeklystandard.com https://www.ucsb.edu https://www.archives.gov https://www.utexas.edu https://www.washingtontimes.com https://www.aier.org https://www.tampabay.com https://womenintheworld.com https://www.channel3000.com https://www.westernmastery.com https://christianliferesources.com https://www.limaohio.com https://www.guttmacher.org https://www.hli.org https://academic.oup.com https://www.ncbi.nlm.nih.gov https://www.cdc.gov https://www.thetimes.co.uk https://www.thinkingchristian.net https://jme.bmj.com https://evolutionnews.org https://www.abortionfacts.com https://www.leagle.com https://caselaw.findlaw.com https://www.abortionno.org https://www.bbc.com https://www.liveaction.org https://www.thejournal.ie https://godparent.org https://www.plannedparenthood.org https://prochoice.org https://www.rebelmouse.com https://www.citizenreviewonline.org https://ftw.usatoday.com
Old entries
The following sites support HTTPS, but do not actively enforce it. They will be updated as well, but undefined entries will also be forced to HTTPS to improve our visitors' security.
| URL | TLS verifed | Processed |
|---|---|---|
| https://thefederalist.com | Y | Y #2 |
| https://www1.cbn.com/cbnnews | Y | Y #2 |
Update runs
- completed 9/26/2018
- completed 4/3/2019 (1738 edits)
- completed 4/10/2019 (4343 edits)