Maitiro ekudhonza dhata, anozivikanwawo sewebhu kutsvaira, anosanganisira kuendesa otomatiki data kubva kune peji rewebhu mufaira. Kune akatiwandei ekutsikisa maturusi aripo. Mabhizinesi nezvimwe zvinhu shandisa web scraping nhasi yekuwana ruzivo nezvevanokwikwidza, kushambadzira, kutora vanhu, uye dzakasiyana siyana dzekuongorora. Asi webhu iri kukwesha zviri pamutemo here?
Mhinduro ndeyekuti zvinoenderana. Ipo chiito chacho pachacho chisiri pamutemo, zvaunoita nedata mushure mekunge zvave chakabviswa zvinogona kuva.
Kubvisa dhata rako pachako
GDPR uye mimwe mitezo yedhata yemunhu akasiyana nyika dzakanyatso kuomarara kana zvasvika pakutora nekuchengetedza dhata remunhu. Saka, kana iwe uri kutsvaira data rako pachako, kunyanya vevagari veEU, iwe unofanirwa kuve ne chikonzero chepamutemo chekudaro. Izvo zvinogona kuva:
- Mvumo yakajeka - zvisingaite kunze kwekunge Mitemo Yekushandisa yewebhu webhusaiti ita kuti vashandisi vazive kuti data ravo rinogona kubviswa pavanosaina. Yakasarudzika mvumo yakajeka inodiwa pakutsvaga data rakaomarara.
- Kufarira chaiko - zvingave zvakaoma kune vanokanganisa kuratidza kuti vane kufarira kwepamutemo pakutsvaira nekuchengetedza dhata remunhu, kunze kwekunge vari vatevedzeri vemutemo kana bazi rehurumende, semuenzaniso.
Iyo GDPR inoda kugadzirisa chete yakawandisa data sezvazvinodiwa kuti uite basa. Tichifunga nezvekuti otomatiki web scraping inowanzo gadziridza yakawanda kwazvo yedhata yezvinangwa zvakasiyana, inogona kutorwa seinopesana neichi GDPR kupihwa.
Sezvo data remamirioni evashandisi veFacebook & LinkedIn anonzi anowanikwa online, @jon_belcher anotarisa #datascraping & mabasa ema media mapuratifomu. https://t.co/FUqXMB1k7X Published @BizMattersmag pic.twitter.com/I5awC1MTKG
- Excello Mutemo (@ExcelloLaw) Kubvumbi 22, 2021
Naizvozvo, kana dhata dhata dzichida kugadzirisa chero data remunhu wevagari veEU, kunyangwe zvikawanikwa pachena, ivo vangangoda kuwana mvumo yavo yakajeka kana kuratidza kufarira kuri pamutemo uye nechinangwa chekudzikisa huwandu hwedata rakaunganidzwa. Izvi zvinoreva chete kutora izvo zvinodiwa kune chakanangana chinangwa / mutengi uye kwete kungo kurodha pasi rese runyorwa runyorwa rwe LinkedIn boka rinosanganisira yega yega mushandisi chimiro, semuenzaniso.
Mutemo uchangopfuura weRussia wedhata wedunhu unoenda padanho. Kubva munaKurume 1 wegore rino, pane mhando nyowani yedhata yemunhu inonzi "data rega rinotenderwa kufambiswa". Izvi zvinoreva, semuenzaniso, kuburitswa kwemakambani anosanganisira dhata rega rega kunze kwezita uye zita rezita revanhu chaivo (mapikicha, zvinzvimbo), kana maCVs pamawebhusaiti ekutsvaga musoro. Chaizvoizvo, inosanganisira zvese zvemunhu pachezvake kugovaniswe izvo zvakabvumidzwa nemusoro wedhata. Kubvumidzwa kwakadaro kunosungirwa, uye iyo data yedhata ine mvumo yekuisa chero zviyero zvavanoda mumvumo iyoyo. Iyi mvumo inofanira kugoverwa newebsite.
Kana iyo data scraper ichida kukwenya dhata rakadaro kubva pawebhu, ivo vanofanirwa kuteedzera nekukanganisa kwemvumo iyoyo. Uye kana iyo data yedhata yakagovana yavo data pachena vega uye isina kupa mvumo, chese chikamu chinoshandisa iyi data chine "mutoro weuchapupu hwekuti ivo vanogadzira iyo data zviri pamutemo“. Naizvozvo, uyu mutemo, senge GDPR, unodzivirira zvakanyanya kuwanda kwekuburitswa kweruzivo rwevanhu ruzivo rwewebhu web scrapers kunogona kuita mukati mehutongi.
Komputa kubiridzira, rekodhi rekodhi, uye kutevedzera
Muna 2019, iyo Dare reUkwidza reU.S. held muchisarudzo chayo mukufarira data analytics kambani hiQ inopesana neLinkedIn iyo data inowanikwa pachena uye isina copyright inogona kubviswa. Nekudaro, izvo zvinoshanda kune ruzivo rwuripo paruzhinji chete.
hiQ Labs, Inc. V. Linkedin Corp .: A Federal Court Inorema Mune PaWebhu Kukorobha, Yemahara Kutaura… https://t.co/hIOWj2b2hE By @ropesgray
- Mondaq (@Mondaq) September 18, 2019
Sezvo ma data scrapers asingakwanise kutsikisa data asiri kuwanikwa paruzhinji, LinkedIn yaisakwanisa kushandisa chakakodzera mutemo - Computer Fraud uye Abuse Act - kuita kuti hiQ irege kutsvaira. Mutemo chete inodzivirira zvakavanzika. Kana, zvakadaro, kambani yekutsvaira dhata ikawana mafaera ane copyright senge mavhidhiyo uye wozoadzosa zvakare nekuda kwekutengeserana, izvo hazvisi pamutemo pamutemo wekopiraiti
Mamwe mawebhusaiti 'Terms of Service zvinorambidza zvakajeka kutsvaira dhata kana kukambaira kwedata chero rorudzi. Aya mazwi anogona zvakare kuva wainyatsotaura mune faira mune webhusaiti midzi dhairekitori rakanzi robots.txt. Kuti ndikupe muenzaniso, ndakatarisa marobhoti.txt epaTwitter kutsvaga mvumo. Heino skrini yechikamu chakakodzera chematemu:
Sezvauri kuona, iyo yekukwasva bots inobvumidzwa kukwenya ma hashtag asi kwete ruzivo nezve vashandisi uye yavo vateveri 'info.
Mabhizinesi anoita sei kutevedzera?
Mabhizinesi anopa data scraping services anofanirwa kutevedzera mitemo nemirairo kuitira kuchengetedza kodzero dzevatengi vavo. Vanofanirwa kubvunzana nezano remutemo nezve data rinotenderwa kukweshwa uye rudzi rwerezinesi runodiwa pairi. Pamusoro pezvo, ivo vanofanirwa kuda kuti vatengi vasayine chibvumirano chepamutemo chinonongedza zvisungo zvavo uye mabasa ane chekuita nekushandiswa kweiyo data scraping service. Pamusoro pezvo, mabhizinesi anofanirwa kuona kuti zvikwata zvavo zvakadzidziswa nemazvo maitiro ekuchengetedza data uye kutevedzera zvakavanzika pakushandisa sevhisi.
Uye zvakadini nevanopa masevhisi eproxy? Semutungamiri mumusika IPPN (IP proxy network), Bright Data yakaisa zviyero zvepamusoro zvekuteedzera muindasitiri yevamiriri. Wese mutsva weBright Data Residence/mobile mutengi anonyatso ongororwa uye anofanirwa kutenderwa nemukuru wekuteerera kuti ave nechokwadi chekuti nyaya yavo yekushandisa inosangana nemiyero yedu yakasimba. Bright Data's in-deep onboarding process inoda kuti vatengi vagovane ID yavo yenyika uye kusaina chirevo chedu chekuteerera pakati pedzimwe nzira dzakasiyana dzekusimbisa zvitupa.
Saka, hunhu hwekukwasva dhata hunotsamira parudzi uye huwandu hwedata rakabviswa. Chero zvingave zvakadaro, zvisinei, zvinogara zvakanaka kuti uve pachena sezvinobvira nezve maitiro ako ekutsvagisa uye uwane zano rehunyanzvi kana usina chokwadi. Iwe unogona zvakare kuda iyo Dziviriro Dziviriro Impact Ongororo pasi peGDPR sevamwe zviremera vanotenda kukwenya data kuve "yakanyanya njodzi isingaonekwi kugadzira".
Mufananidzo wechikwereti: Iyo yakaratidzwa mufananidzo yatorwa na Maxim Hopman. Iyo skrini yakatorwa nemunyori weTechAcute.
Sources: Zyte / Alexander Demchenko (DataOx) / Srishti Saha (datahut) / GDPR ruzivo / Stanislav Rumyantsev (IAPP) / Fiona Campbell (Mushambadzi)
