Hi everyone! I was stuck trying to figure this out. spend so many hours over this so decided to get opinion from you people before diving into another rabbit hole, TIA.
Problem:
I was working on a web scraping project. I scraped descriptions of thousands of sellers to get data out of them. I extracted most of the data like,
[CompanyName, SellerName, Rating, Reviews, zip codes] etc.
but extracting telephone numbers is being a nuisance. Ive tried many combinations of RE but since people have inconsistently put their telephone numbers i cant find a common ground that will work for most numbers. i gathered like 450/1000 numbers because they were in a specific format, and some were officially on the page, but that’s it.
There can also be other numbers in the text like (VAT number, Trade registration, Zip code etc.), So maybe my RE arent good enough but I cant figure this out.
What I’m thinking doing next.
Make a list of RE(s) to cover as much types of commonly occurring phone numbers and then compare all numbers in the text.
Some different types of phone numbers that i extracted manually
Telephone
34966345011
0-871-345-4194
593134598
03301 234508
0228 234516
4939181345909
06192/345870
49 9345 - 910510
64012234556
49 (0)3453 738
49341 934595 61
03435345119
0355 435446
49 40 3345 325-0
03672 413457
Some samples that contain phone numbers: (Masked a bit)
Detailed Seller Information
Business seller
Business Name: INTERNATIONAL S.L.
Business Type: Privately-owned business
Trade Register Number: B5491
VAT Number: ESB549
Phone number: 0034966933099
Business Address:
Carretera de Ocaña 12
Aliinte
Alxxnte
03336
ES
"Detailed Seller Information
Business seller
Business Name: Bexxzeit GxxH
Business Type: Privately-owned business
Trade Register Number: Amtxxxricht MÃxxxhen, HRB 164298
VAT Number: DE814724454
Representative Name: Maxxn Sxxxenxxxger
Customer Services Address:
Georg-Kxxxl-StxxxŸe 1
Otxxxing
Bayern
83642
DE
Business Address:
Gxxg-Kaxxl Str. 1
Bergzeit GxxH
Otxxrfing
83324
DE"
"Detailed Seller Information
Business seller
Business Name: Hxxxfer Haxs Pexxr
Business Type: Privately-owned business
Trade Register Number: Kxxe
VAT Number: DE117295429
Representative Name: Hxxs-Pxxer Hxxer
Contact number: 0593523898
Customer Services Address:
Am Neuen Mxxxt 32
Mxxxen
Niedexxxen
49716
DE
Business Address:
Am Nxxen Markt
32
Mxxxen
49716
DE"
"Detailed Seller Information
Business seller
Business Name: Spxxxxp Ruxxxng Man
Business Type: Privately-owned business
Trade Register Number: Kxxxe
VAT Number: DE242341905
Representative Name: S.Hxxxe
Helpline: 03301 252308
Customer Services Address:
Spoxxxp Runxxxg Man Bxxxuer Straße 16
Oraxxxurg
Brandenburg
16515
DE
Business Address:
Running Man Sport
Bxxxuer Straße 16
Oraxxxurg
16515
DE"
"Detailed Seller Information
Business seller
Business Name: Sport-Shop Brüser Berg OHG
Business Type: Prixxxly-owned business
Trade Register Number: 9425
VAT Number: DE318439271
Representative Name: Axxxr Gxxxki
Telephone: 015785326044
Customer Services Address:
Wegscheid 4
Alfter
53347
DE
Business Address:
Borsigallee
Borsigallee 9
Bonn
53125
DE"