Inqubo yokususwa kwedatha, eyaziwa nangokuthi i-web scraping, ifaka ukungenisa ngokuzenzakalela idatha esuka ekhasini lewebhu iye kufayela. Kunamathuluzi amaningi okususa atholakalayo. Amabhizinisi nezinye izinhlangano sebenzisa i-web scraping namuhla ukuthola imininingwane ngezimbangi, ukumaketha, ukuqashwa, nezinhlobo ezahlukahlukene zokuhlaziywa. Kepha ingabe i-web scraping isemthethweni?
Impendulo incike. Nakuba isenzo ngokwaso singekho emthethweni, wenzani ngedatha ngemva kokwenziwa khuhliwe kungaba njalo.
Ukusula idatha yomuntu siqu
I-GDPR neminye imithetho yedatha yomuntu siqu yamazwe ahlukene iqine impela uma kukhulunywa ngokuqoqa nokugcina idatha yomuntu siqu. Ngakho-ke, uma usula imininingwane yomuntu, ikakhulukazi izakhamizi ze-EU, udinga ukuthi ube ne- isizathu esisemthethweni sokwenza kanjalo. Lokho kungaba:
- Imvume ecacile - akunakwenzeka ngaphandle kokuthi Imibandela Yokusebenzisa iwebhusayithi yazisa abasebenzisi ukuthi idatha yabo ingahle isulwe lapho bebhalisa. Imvume ekhethekile ecacile iyadingeka ukusula idatha ebucayi.
- Inzalo esemthethweni - kungaba nzima ukuthi ama-scrapers akhombise ukuthi anentshisekelo efanele ekukhukhumeni nasekugcineni idatha yomuntu siqu, ngaphandle kokuthi abezomthetho noma abasebenzela uhulumeni, ngokwesibonelo.
I-GDPR idinga ukucubungula kuphela idatha eningi ngangokunokwenzeka ukufeza umsebenzi. Njengoba kunikezwe ukuthi i-web scraping ezenzakalelayo ivame ukucubungula idatha enkulu kakhulu ngezinhloso ezahlukahlukene, kungathathwa njengokuphikisana nalokhu kunikezwa kwe-GDPR.
Njengoba kusolwa imininingwane yezigidi zabasebenzisi be-Facebook ne-LinkedIn online, @sbahle_mpisane abuke #datascraping Nemithwalo yemfanelo yezingxenyekazi zemidiya. https://t.co/FUqXMB1k7X Kushicilelwe @BizMattersmag pic.twitter.com/I5awC1MTKG
- Umthetho we-Excello (@ExcelloLaw) 22 Ephreli 2021
Ngakho-ke, uma ama-scraper edatha edinga ukucubungula noma iyiphi idatha yomuntu siqu yezakhamizi ze-EU, noma ngabe itholakala esidlangalaleni, kungadingeka ukuthi bathole imvume yabo ecacile noma bafakazele intshisekelo esemthethweni futhi bahlose ukunciphisa inani lemininingwane eqoqiwe. Lokho kusho ukuqoqa kuphela okudingekayo ngenhloso ethile / iklayenti hhayi nje ukulanda lonke uhlu lwabasebenzisi beqembu le-LinkedIn kufaka phakathi iphrofayili yomsebenzisi ngamunye, ngokwesibonelo.
Umthetho wakamuva wedatha yomuntu siqu waseRussia udlulela phambili. Kusukela ngoMashi 1 walo nyaka, kukhona uhlobo olusha lwedatha yomuntu siqu olubizwa ngokuthi "idatha yomuntu siqu evunyelwe ukusatshalaliswa". Lokho kusho ukuthi, ngokwesibonelo, ukukhishwa kwabezindaba kwezinkampani ezifaka imininingwane yomuntu ngaphandle kwegama nesibongo sabantu abathile (izithombe, izikhundla), noma ama-CV kumawebhusayithi wokuzingela. Empeleni, kufaka yonke idatha yomuntu siqu ekusatshalalisweni okuvunyelwe yisihloko sedatha. Imvume enjalo iyimpoqo, futhi isihloko sedatha sinelungelo lokufaka noma yimiphi imikhawulo abayifunayo kuleyo mvume. Le mvume kumele yabelwe yiwebhusayithi.
Uma isisusa sedatha sifisa ukusula leyo datha kuwebhu, kufanele bahambisane nemikhawulo yaleyo mvume. Futhi uma isihloko sedatha sabelane ngemininingwane yabo esidlangalaleni bebodwa futhi singanikanga imvume, lonke ibhizinisi elisebenzisa le datha line- “umthwalo wobufakazi bokuthi bacubungula imininingwane ngokusemthethweni“. Ngakho-ke, lo mthetho, njenge-GDPR, uvimbela kakhulu ukuthi kungakanani ukususwa kwedatha yomuntu siqu etholakalayo esidlangalaleni engenziwa ngaphakathi kwegunya.
Ukukhwabanisa kwekhompyutha, idatha ene-copyright, nokuhambisana
Ngo-2019, iNkantolo Yokudlulisa Amacala yase-US ebanjwe esinqumweni sayo esivuna inkampani ye-data analytics hiQ ngokumelene ne-LinkedIn leyo datha etholakala esidlangalaleni futhi engenayo i-copyright ingacinywa. Noma kunjalo, lokho kusebenza emininingwaneni etholakala emphakathini kuphela.
i-hiQ Labs, Inc. V. Linkedin Corp .: INkantolo Yomfelandawonye Ilinganisela Ku-Web Scraping, Inkulumo yamahhala… https://t.co/hIOWj2b2hE By @simphiwedana
- Mondaq (@Mondaq) September 18, 2019
Njengoba ama-data scrapers engakwazi ukusika idatha engatholakali esidlangalaleni, i-LinkedIn ayikwazanga ukusebenzisa umthetho ofanele - Umthetho Wokukhwabanisa Kwekhompyutha kanye Nokuhlukumeza - ukwenza i-hiQ iyeke ukusula. Umthetho kuphela ivikela imininingwane eyimfihlo. Uma, noma kunjalo, inkampani edonsa idatha ithola amafayela anamalungelo obunikazi afana namavidiyo bese ewathumela kabusha ngezinjongo zokuhweba, lokho akukho emthethweni ngaphansi komthetho we-copyright.
Imigomo yesevisi yamawebhusayithi athile iyakwenqabela ngokusobala ukususwa kwedatha noma ukukhasa kwedatha kwanoma yiluphi uhlobo. Le migomo ingaba futhi kuchaziwe kufayela elisenkombeni yezimpande yewebhusayithi enesihloko esithi robots.txt. Ukukunikeza isibonelo, ngibheke i-robots.txt ye-Twitter ukuthola izimvume. Nasi isithombe-skrini sengxenye efanele yemigomo:
Njengoba ukwazi ukubona, ama-bots scraping avunyelwe ukuskena ama-hashtag kepha hhayi imininingwane mayelana nabasebenzisi nemininingwane yabalandeli babo.
Amabhizinisi akwenza kanjani ukuthobela imithetho?
Amabhizinisi ahlinzeka ngezinsizakalo zokukhuhla idatha kufanele athobele imithetho nezimiso ukuze avikele amalungelo amakhasimende awo. Kufanele baxhumane nomeluleki wezomthetho mayelana nokuthi iyiphi idatha evunyelwe ukuthi isulwe nokuthi hlobo luni lwelayisensi oludingekayo kuyo. Ukwengeza, kufanele bafune amakhasimende ukuthi asayine isivumelwano esibopha ngokusemthethweni esichaza izibopho zabo nezibopho zabo mayelana nokusetshenziswa kwesevisi yokukhuhla idatha. Ngaphezu kwalokho, amabhizinisi kufanele aqinisekise ukuthi amaqembu abo aqeqeshwe kahle ezindleleni ezingcono kakhulu zokuvikela idatha nokuthobela ubumfihlo lapho esebenzisa isevisi.
Futhi kuthiwani ngabahlinzeki besevisi yommeleli? Njengomholi emakethe ye-IPPN (IP proxy networks), Idatha Ekhanyayo usethe amazinga aphezulu okuthobela embonini yama-proxy. Lonke ikhasimende elisha le-Bright Data Residential/lomakhalekhukhwini lihlolwa ngokucophelela futhi kufanele ligunyazwe isikhulu sokuthobela imithetho ukuze siqinisekise ukuthi udaba lwalo lokusebenzisa luhlangabezana nezindinganiso zethu eziqinile. Inqubo yokungena ejulile ye-Bright Data idinga amakhasimende ukuthi abelane nge-ID yawo kazwelonke futhi asayine isitatimende sethu sokuthobelana phakathi kwamanye amasu ahlukahlukene okuqinisekisa.
Ngakho-ke, ukuba semthethweni kokukhutshwa kwedatha kuncike ohlotsheni nasenanini ledatha elikhutshiwe. Noma ngabe yikuphi, noma kunjalo, kungcono ngaso sonke isikhathi ukuthi ubonakale ngokusobala ngangokunokwenzeka mayelana nemikhuba yakho yokukhuhla futhi uthole izeluleko zobuchwepheshe uma ungaqiniseki. Ungadinga futhi Ukuhlolwa Komthelela Wokuvikelwa Kwedatha ngaphansi kwe-GDPR njengoba ezinye iziphathimandla zikholelwa ukuthi ukususwa kwedatha kube “ukucubungula okungabonakali okukhulu".
Isikweletu sezithombe: Okufakiwe isithombe kuthathwe ngu UMaxim Hopman. Isithombe-skrini sithathwe ngumbhali weTechAcute.
Imithombo: Zyte / Alexander Demchenko (IdathaOx) / Srishti Saha (idathahut) / Imininingwane ye-GDPR / UStanislav Rumyantsev (I-IAPP) / UFiona Campbell (I-Fieldfisher)
