#osm-ru | Logs for 2014-03-09

Back
[00:00:01] -!- Komzzpa has quit [Ping timeout: 480 seconds]
[00:01:45] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[00:07:36] -!- SoNick_RND[CGI206] has quit [Quit: CGI:IRC]
[00:07:48] -!- zverik_ has quit [Ping timeout: 480 seconds]
[00:12:06] -!- ErshKUS has quit [Ping timeout: 480 seconds]
[00:16:21] -!- Scondo [Scondo!~Miranda@2a00:e78:4:7:4047:6cfa:eb3d:fb3d] has joined #osm-ru
[00:28:35] -!- Scondo has quit [Quit: Lost in time. And lost in space. And meaning.]
[00:43:13] -!- Komzzpa has quit [Ping timeout: 480 seconds]
[00:54:15] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[00:57:15] -!- Komzzpa has quit []
[00:57:19] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[01:16:54] -!- Alex_[MapsWithMe] [Alex_[MapsWithMe]!~AlexZolot@37.17.115.70] has joined #osm-ru
[01:17:34] -!- Alex_[MapsWithMe]1 [Alex_[MapsWithMe]1!~AlexZolot@37.17.11.85] has joined #osm-ru
[01:17:35] -!- Alex_[MapsWithMe] has quit [Read error: Connection reset by peer]
[01:25:21] -!- Komzzpa has quit [Remote host closed the connection]
[01:27:50] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[01:32:58] -!- Mezonin [Mezonin!~den@31.23.203.142] has joined #osm-ru
[01:39:21] -!- Mezonin_ has quit [Ping timeout: 480 seconds]
[01:45:26] -!- Komzzpa has quit [Ping timeout: 480 seconds]
[01:45:26] -!- Alex_[MapsWithMe]1 has quit [Read error: Connection reset by peer]
[01:54:23] -!- tryagain has quit [Remote host closed the connection]
[02:15:03] -!- old_Bibigon has quit [Ping timeout: 480 seconds]
[02:27:00] -!- Alex_[MapsWithMe] [Alex_[MapsWithMe]!~AlexZolot@178.124.110.226] has joined #osm-ru
[02:39:18] -!- Mezonin_ [Mezonin_!~den@31.23.133.92] has joined #osm-ru
[02:45:52] -!- Mezonin has quit [Ping timeout: 480 seconds]
[02:54:40] -!- Alex_[MapsWithMe] has quit [Quit: Leaving.]
[03:26:52] -!- CutterRus has quit [Remote host closed the connection]
[03:31:12] -!- private has quit [Read error: Connection reset by peer]
[05:51:03] -!- iav has quit [Ping timeout: 480 seconds]
[07:21:06] -!- jekhor [jekhor!~jek@134.17.132.55] has joined #osm-ru
[08:07:18] -!- jekhor has quit [Read error: No route to host]
[08:07:29] -!- jekhor [jekhor!~jek@134.17.132.55] has joined #osm-ru
[08:38:31] -!- jekhor has quit [Ping timeout: 480 seconds]
[08:44:21] -!- runich [runich!~runich@2a02:17d0:183:1d00:9cc6:7d70:338b:9639] has joined #osm-ru
[08:52:25] -!- runich has quit [Ping timeout: 480 seconds]
[09:07:13] -!- gryphon [gryphon!~gryphon@net03113209750.pskovline.ru] has joined #osm-ru
[09:09:00] -!- az09|eee [az09|eee!~e@176.215.214.118] has joined #osm-ru
[09:38:14] -!- runich [runich!~runich@188.226.107.80] has joined #osm-ru
[09:38:55] -!- runich has quit [Remote host closed the connection]
[09:44:12] -!- ErshKUS [ErshKUS!~ErshKUS@ppp31-192-133-28.tis-dialog.ru] has joined #osm-ru
[09:46:38] -!- zverik_ [zverik_!~zverik@178.70.82.253] has joined #osm-ru
[09:55:18] -!- zverik_ has quit [Ping timeout: 480 seconds]
[10:31:33] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[10:32:57] -!- private [private!~mike@89-178-93-148.broadband.corbina.ru] has joined #osm-ru
[10:36:09] -!- az09|eee has quit [Remote host closed the connection]
[11:44:47] -!- old_Bibigon [old_Bibigon!~bibigon@static-92-39-68-20.kirov.comstar-r.ru] has joined #osm-ru
[12:05:47] -!- sh4 [sh4!kldfkdlsf@178.45.157.238] has joined #osm-ru
[12:06:49] -!- sh3 [sh3!~axwer@178.45.157.238] has joined #osm-ru
[12:06:54] -!- sh3 has quit []
[13:10:54] -!- jekhor [jekhor!~jek@134.17.132.55] has joined #osm-ru
[13:34:48] -!- private has quit [Ping timeout: 480 seconds]
[13:59:39] -!- private [private!~mike@89-178-93-148.broadband.corbina.ru] has joined #osm-ru
[15:10:49] -!- zverik_ [zverik_!~zverik@178.70.82.253] has joined #osm-ru
[15:39:59] -!- Komzzpa has quit [Read error: Connection reset by peer]
[15:40:16] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[16:11:24] -!- iav [iav!iav@customer-193.33.livas.lv] has joined #osm-ru
[16:23:20] -!- Komzzpa has quit [Remote host closed the connection]
[16:23:43] -!- Komzzpa [Komzzpa!~kom@5.149.156.131] has joined #osm-ru
[16:40:19] -!- unnicked043 [unnicked043!~5291d244@208.94.232.249] has joined #osm-ru
[16:45:20] -!- unnicked043 has quit [Quit: CGI:IRC (Ping timeout)]
[17:13:57] -!- runich [runich!~runich@188.226.107.80] has joined #osm-ru
[17:14:40] -!- runich has quit [Remote host closed the connection]
[17:28:42] -!- Komzzzpa [Komzzzpa!~kom@5.149.156.131] has joined #osm-ru
[17:30:53] -!- Komzzpa has quit [Read error: Operation timed out]
[17:38:59] -!- olamedia [olamedia!~olamedia@172.162-142-79.FTTH.rus-com.net] has joined #osm-ru
[17:39:15] <olamedia> привет
[17:39:32] <olamedia> кто знает, сколько relation всего?
[17:40:06] <olamedia> у меня планета третьи сутки импортируется :/
[17:40:56] <olamedia> причем ноды и пути все быстро за полдня обработались...
[17:41:36] -!- Hind [Hind!~59a9e41e@shenron.openstreetmap.org] has joined #osm-ru
[17:41:40] <Hind> olamedia: http://www.openstreetmap.org/stats/data_stats.html
[17:42:36] <olamedia> 2341810/2421316 ураа
[17:42:49] <olamedia> значит не так долго осталось
[17:43:56] <olamedia> еще пару часов
[17:44:59] -!- Hind has quit [Remote host closed the connection]
[17:53:47] -!- jekhor has quit [Ping timeout: 480 seconds]
[17:56:46] -!- Komzzzpa has quit [Remote host closed the connection]
[17:57:13] -!- Komzzzpa [Komzzzpa!~kom@5.149.156.131] has joined #osm-ru
[18:13:14] -!- Komzzzpa has quit [Remote host closed the connection]
[18:25:18] -!- iav has quit [Ping timeout: 480 seconds]
[18:52:35] -!- private has quit [Read error: Connection reset by peer]
[18:59:57] -!- gryphon_ [gryphon_!~gryphon@net03113209750.pskovline.ru] has joined #osm-ru
[19:08:09] <shurik> olamedia: парсинг файла это полдела, потом ещё будет доооолгий постпроцессинг
[19:09:39] <olamedia> ну, relation у меня со скоростью 11/с обрабатываются :/ не думаю, что будет что-то хуже
[19:10:04] <olamedia> быстрее всего ноды были, 746k/s
[19:11:46] <shurik> ну это очевидно что они проще всего
[19:11:51] <shurik> Node stats: total(1893880995), max(2302181851) in 1942s
[19:11:52] <shurik> Way stats: total(182995512), max(221162188) in 9414s
[19:11:54] <shurik> Relation stats: total(1939821), max(2924181) in 18260s
[19:12:22] <shurik> вся загрузка 83962.77s
[19:13:43] -!- gryphon_ has quit [Remote host closed the connection]
[19:22:51] -!- private [private!~mike@89-178-93-148.broadband.corbina.ru] has joined #osm-ru
[19:25:50] <olamedia> Node stats: total(2219907428), max(2690761990) in 2974s
[19:25:51] <olamedia> Way stats: total(219165876), max(263455999) in 7528s
[19:25:51] <olamedia> Relation stats: total(2400894), max(3537737) in 213993s
[19:29:26] <olamedia> и я понятия не имею почему у меня в 10 раз дольше relation парсились
[19:43:06] -!- gryphon_ [gryphon_!~gryphon@net03113209750.pskovline.ru] has joined #osm-ru
[19:43:06] -!- gryphon has quit [Remote host closed the connection]
[20:00:36] <shurik> olamedia: очевидно почему - они заметно сложнее
[20:01:23] <olamedia> сравни 1942s/9414s/18260s против 2974s/7528s/213993s
[20:01:26] <shurik> ноды упираются в диск, а с веями и релейшнами всё не так просто
[20:01:41] <shurik> кстати база на ssd?
[20:02:42] <olamedia> 2 x 3 TB HDD SATA3 (software RAID1)
[20:04:10] <shurik> flatnodes используются?
[20:06:34] <olamedia> да
[20:07:25] <olamedia> 20 гигов для osm2pgsql было выделено оперативки
[20:08:10] <olamedia> еще вопрос, если я качал planet-140226.osm.bz2 мне следующий changesets-140305.osm.bz2 грузить?
[20:08:46] <olamedia> или в changesets-140226.osm.bz2 тоже мог что-то пропустить...
[20:09:57] <shurik> нет, нужно из planet.osm.org/replication/day/
[20:10:07] <shurik> лучше с помощью osmctools или osmosis
[20:10:20] <shurik> есть ещё шайтанкомбайн https://github.com/Komzpa/furry-sansa
[20:12:25] <olamedia> я просто хотел до нескольких дней вручную сократить... а тут как раз новый changeset вышел
[20:14:03] <olamedia> как бы в крон повесить, чтобы он сервак не уронил...
[20:17:17] <shurik> у меня пока с обновлениями плохо
[20:47:52] -!- Komzzzpa [Komzzzpa!~kom@5.149.156.131] has joined #osm-ru
[20:56:43] -!- iav [iav!~iav@customer-193.33.livas.lv] has joined #osm-ru
[20:59:15] -!- Komzzzpa has quit [Remote host closed the connection]
[20:59:33] -!- Komzzzpa [Komzzzpa!~kom@5.149.156.131] has joined #osm-ru
[20:59:39] -!- gryphon [gryphon!~gryphon@net03113209750.pskovline.ru] has joined #osm-ru
[21:01:54] -!- private has quit [Read error: Connection reset by peer]
[21:04:45] -!- gryphon has quit [Remote host closed the connection]
[21:31:02] -!- iav has quit [Ping timeout: 480 seconds]
[21:38:47] -!- sh4 has quit [Remote host closed the connection]
[22:10:24] -!- CutterRus [CutterRus!~CutterRus@178.76.242.163] has joined #osm-ru
[22:19:56] -!- private [private!~mike@89-178-93-148.broadband.corbina.ru] has joined #osm-ru
[23:01:11] -!- iav [iav!~iav@customer-193.33.livas.lv] has joined #osm-ru