r - Cleaning and editing a column -

-

i've been trying figure out how clean , edit column in data set.

the dataset using supposed city of san francisco. column in data set called "city" contains multiple different spellings of san francisco, other cities. here looks like:

table(sf$city)

                                  brentwood                      ca                30401                      18                     370            daly city             foster city                 hayward                    0                       0                       0               novato                 oakland                 oakland                    0                      40                       0                  s f                    s.f.                 s.f. ca                    0                   31428                      12            san bruno           san francicso          san franciisco                    0                     221                      54        san francisco           san francisco           san francisco                   20                     284                       0        san francisco           san francisco        san francisco ca                78050                   16603                       6       san francisco,       san francisco, ca       san francisco, ca                   12                       4                      72  san francisco, ca 94132          san franciscvo           san francsico                    0                       0                       2       san franicisco          sand francisco                      sf                   41                      30                      17                   sf                      sf                 sf , ca                  214                   81226                       1         sf ca  94133                  sf, ca            sf, ca 94110                    0                       9                      38         sf, ca 94115                     sf.                     sf`                    4                    1656                      31    so. san francisco                 so.s.f.                    0                       6

what trying change sf$city have "san francisco". data in sf$city placed under 1 city, san francisco. when type table(sf$city), shows san francisco.

could subset? like:

sf$city = subset(sf, city == "s.f." & "s.f. ca" & "san francicso" & ...

and subset city variables want? or distort , mess data?

i try regular expressions agrep , grep.

example data:

d <- c("brentwood", "ca", "daly city", "foster city", "hayward", "novato",  "oakland", "oakland", "s f", "s.f.", "s.f. ca", "san bruno",  "san francicso", "san franciisco", "san francisco", "san francisco",  "san francisco", "san francisco", "san francisco", "san francisco ca",  "san francisco,", "san francisco, ca", "san francisco, ca", "san francisco, ca 94132",  "san franciscvo", "san francsico", "san franicisco", "sand francisco",  "sf", "sf", "sf", "sf , ca", "sf ca", "94133", "sf, ca", "sf, ca 94110",  "sf, ca 94115", "sf.", "sf`", "so. san francisco", "so.s.f.")

you can target words "san francisco" agrep, , default of max.dist = 0.1 works enough here. can target s.f. variants using grep

d[agrep("san francisco", d, ignore.case = true, max.dist = 0.1)] <- "san francisco"  d[grep("\\bs[. ]?f\\.?\\b", d, ignore.case = true, perl = true)] <- "san francisco"  # [1] "brentwood"     "ca"            "daly city"     "foster city"   # [5] "hayward"       "novato"        "oakland"       "oakland"       # [9] "san francisco" "san francisco" "san francisco" "san bruno"     #[13] "san francisco" "san francisco" "san francisco" "san francisco" #[17] "san francisco" "san francisco" "san francisco" "san francisco" #[21] "san francisco" "san francisco" "san francisco" "san francisco" #[25] "san francisco" "san francisco" "san francisco" "san francisco" #[29] "san francisco" "san francisco" "san francisco" "san francisco" #[33] "san francisco" "94133"         "san francisco" "san francisco" #[37] "san francisco" "san francisco" "san francisco" "san francisco" #[41] "san francisco"

adist option targeting words "san francisco". found following settings work well. can pick "san fran":

d[adist("san francisco", d, ignore.case = true,     cost = c(del = 0.5, ins = 0.5, sub = 3)) < 3] <- "san francisco"

Comments

Post a Comment

Popular posts from this blog

ios - RestKit 0.20 — CoreData: error: Failed to call designated initializer on NSManagedObject class (again) -

-
this error has shown on many times, seems. prominent answer issue seems restkit 0.20 — coredata: error: failed call designated initializer on nsmanagedobject class however, solution posted doesn't work me. let's start beginning: i want upload file server. want parse response make sure uploaded. if not, try again later. model has boolean variable called nsnumber *senttoserver purpose (in coredata, bool saved nsnumber ) . because don't know whether sending going successful, save entity coredata model first before sending via restkit. when post request successful, server returns json string this: {"id":14,"created":true} notice that, of course, id not set on coredata model yet, both id , created new informations model. here's model: @interface recording : nsmanagedobject @property (nonatomic, retain) nsstring * audiofilepath; @property (nonatomic, retain) nsdate * createdat; @property (nonatomic, retain) nsstring * deviceid; @...
Read more

java - Digest auth with Spring Security using javaconfig -

-
so i'm trying create digest authentication spring following documentation trying translate xml "requirements" in java requirements. let's have xml in docs: <bean id="digestfilter" class= "org.springframework.security.web.authentication.www.digestauthenticationfilter"> <property name="userdetailsservice" ref="jdbcdaoimpl"/> <property name="authenticationentrypoint" ref="digestentrypoint"/> <property name="usercache" ref="usercache"/> </bean> <bean id="digestentrypoint" class= "org.springframework.security.web.authentication.www.digestauthenticationentrypoint"> <property name="realmname" value="contacts realm via digest authentication"/> <property name="key" value="acegi"/> <property name="noncevalidityseconds" value="10"/> </b...
Read more

laravel - PDOException in Connector.php line 55: SQLSTATE[HY000] [1045] Access denied for user 'root'@'localhost' (using password: YES) -

-
my .env: app_env=local app_debug=true app_key=myappkey app_url=http://localhost db_connection=mysql db_host=localhost db_port=3306 db_database=gestiontaller db_username=root db_password='root' cache_driver=file session_driver=file queue_driver=sync redis_host=127.0.0.1 redis_password=null redis_port=6379 mail_driver=smtp mail_host=mailtrap.io mail_port=2525 mail_username=null mail_password=null mail_encryption=null i've tried password ", ' , without, restarting server every time. i've tried changing localhost 172.0.0.1. yes, password correct, running mysql -u root -p introducing password root in prompt can go mysql. users table: +------------------+-----------+ | user | host | +------------------+-----------+ | debian-sys-maint | localhost | | mysql.sys | localhost | | root | localhost | | root1 | localhost | +------------------+-----------+ i've added homestead.yaml this: database_port: 3306 ...
Read more