freemem (江平)

Ruby 如何获取跳转后的 URL

freemem — Fri, 11 May 2012 10:47:59 +0800

除了下面这个方法，还有什么更简单的办法？（我不想为此小事而装一个 httpclient gem） rails httpclient 获取转换后的地址： http://guduxiaoxian.iteye.com/blog/1156047

我用 nokogiri 做抓取时需要知道某 url 跳转后的 url，如： http://t.cn/h34YC 的真实地址是： http://www.guwendong.com/post/2008/social_media_algorithm_reddit.html 我要获取这个真实地址。

end of file reached 的问题一般是什么原因引起？

freemem — Wed, 02 May 2012 21:39:58 +0800

rake aborted!
end of file reached
/usr/local/ruby/lib/ruby/1.8/net/protocol.rb:135:in `sysread'
/usr/local/ruby/lib/ruby/1.8/net/protocol.rb:135:in `rbuf_fill'
/usr/local/ruby/lib/ruby/1.8/timeout.rb:62:in `timeout'
/usr/local/ruby/lib/ruby/1.8/timeout.rb:93:in `timeout'
/usr/local/ruby/lib/ruby/1.8/net/protocol.rb:134:in `rbuf_fill'
/usr/local/ruby/lib/ruby/1.8/net/protocol.rb:116:in `readuntil'
/usr/local/ruby/lib/ruby/1.8/net/protocol.rb:126:in `readline'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:2020:in `read_status_line'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:2009:in `read_new'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:1050:in `request'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:1037:in `request'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:543:in `start'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:1035:in `request'
/usr/local/ruby/lib/ruby/1.8/net/http.rb:772:in `get'
/usr/local/ruby/lib/ruby/gems/1.8/gems/faraday-0.8.0/lib/faraday/adapter/net_http.rb:70:in `perform_request'
/usr/local/ruby/lib/ruby/gems/1.8/gems/faraday-0.8.0/lib/faraday/adapter/net_http.rb:35:in `call'
/usr/local/ruby/lib/ruby/gems/1.8/gems/faraday-0.8.0/lib/faraday/request/url_encoded.rb:14:in `call'
/usr/local/ruby/lib/ruby/gems/1.8/gems/faraday-0.8.0/lib/faraday/connection.rb:226:in `run_request'
/usr/local/ruby/lib/ruby/gems/1.8/gems/oauth2-0.5.2/lib/oauth2/client.rb:88:in `request'
/usr/local/ruby/lib/ruby/gems/1.8/gems/oauth2-0.5.2/lib/oauth2/access_token.rb:98:in `request'
/usr/local/ruby/lib/ruby/gems/1.8/gems/weibo2-0.1.0/lib/weibo2/interface/base.rb:15:in `request'
/usr/local/ruby/lib/ruby/gems/1.8/gems/weibo2-0.1.0/lib/weibo2/interface/base.rb:23:in `get'
/usr/local/ruby/lib/ruby/gems/1.8/gems/weibo2-0.1.0/lib/weibo2/interface/statuses.rb:67:in `user_timeline'
/root/rss/rakefile.rb:28
/root/rss/rakefile.rb:26:in `each'
/root/rss/rakefile.rb:26
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:205:in `call'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:205:in `execute'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:200:in `each'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:200:in `execute'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:158:in `invoke_with_call_chain'
/usr/local/ruby/lib/ruby/1.8/monitor.rb:242:in `synchronize'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:151:in `invoke_with_call_chain'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/task.rb:144:in `invoke'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:116:in `invoke_task'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:in `top_level'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:in `each'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:94:in `top_level'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:133:in `standard_exception_handling'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:88:in `top_level'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:66:in `run'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:133:in `standard_exception_handling'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/lib/rake/application.rb:63:in `run'
/usr/local/ruby/lib/ruby/gems/1.8/gems/rake-0.9.2.2/bin/rake:33
/usr/local/ruby/bin/rake:19:in `load'
/usr/local/ruby/bin/rake:19

Nokogiri 解析 html 时出现 no such file or directory ，怎么解决？

freemem — Wed, 02 May 2012 11:35:24 +0800

这个貌似是同样的问题：http://www.iteye.com/problems/43990

以下正则匹配 10 个有意义的字符，Ruby 下貌似出错。

freemem — Tue, 01 May 2012 17:47:00 +0800

难道是因为区间里面不能有区间吗？

[[\u4e00-\u9fa5],\.\;\?\$''""\-\(\)\[\]，。;？￥·、（）「］\w]{2,}

用户 Nokogiri 解析到乱码，我该写一个什么方法让以下内容不存入数据库？

freemem — Tue, 01 May 2012 16:47:27 +0800

假设此变量为：p.text

äº¬ä¸œå•†åŸŽå’Œä¸å›½äºšé©¬é€Šä»Šæ—¥ç‰¹ä»·æŠ¥ï¿¥1899åŒ…é‚®ï¼ŒåŽ†å²ä½Žä»·ï¼Œä½ŽäºŽå…¶ä»–B2Cæ¸ é“è‡³å°‘ï¿¥2099ä»¥ä¸Šçš„æŠ¥ä»·ã€‚æ³¨ï¼šæ¤æ¬¾ç›®å‰å·²å¯ä»¥å‡çº§åˆ°android 4.0ã€‚

Nokogiri 在 Linux CentOS 5 下不工作

freemem — Mon, 30 Apr 2012 21:54:24 +0800

建立了一个 rake 任务，在 MacOS 下运行正常，在 linux centOS5 下不工作，也不报错，什么原因？请高手帮忙看看，这是部分代码：

task :grab do
  require 'rubygems'
  require 'activerecord'
  require 'nokogiri'
  require 'open-uri'
  require 'article'

 @article = Article.new
 @article.class = "1"
 @article.time = Time.gm(*Time.now)

#上面代码正常（数据可正常存入数据库），以下代码在 MacOS 下运行正常，在 linux centOS5 下不工作：

 link="http://www.cnblogs.com/ilazysoft/archive/2011/11/04/2236337.html"
  doc = Nokogiri::HTML(open(link))
  doc.css("#single a,").each do |a|
  reg = /更多详情/
  if a.text =~ reg
      @article.olink = a[:href]
      break
    end
  end
 doc.css("#single p").each do |p|
  reg = /.{140,}/
  if p.text =~ reg
    @article.description = p.text
    break
  end
end
@article.save

用 Sinatra 开发的应用如何使用 will_paginate 翻页？

freemem — Mon, 30 Apr 2012 11:02:26 +0800

no rails.