/
usr
/
local
/
share
/
man
/
man3
/
/usr/local/share/man/man3
mkdir
upload
Name
Size
Mode
Actions
App::Prove.3pm
10508
0444
edit
dl
rm
App::Prove::State.3pm
6005
0444
edit
dl
rm
App::Prove::State::Result.3pm
5619
0444
edit
dl
rm
App::Prove::State::Result::Test.3pm
5051
0444
edit
dl
rm
AppConfig.3pm
35289
0444
edit
dl
rm
AppConfig::Args.3pm
7992
0444
edit
dl
rm
AppConfig::CGI.3pm
6609
0444
edit
dl
rm
AppConfig::File.3pm
12614
0444
edit
dl
rm
AppConfig::Getopt.3pm
7444
0444
edit
dl
rm
AppConfig::State.3pm
24972
0444
edit
dl
rm
AppConfig::Sys.3pm
6695
0444
edit
dl
rm
Archive::Tar.3pm
44061
0444
edit
dl
rm
Archive::Tar::File.3pm
11083
0444
edit
dl
rm
Archive::Zip.3pm
69985
0444
edit
dl
rm
Archive::Zip::FAQ.3pm
18437
0444
edit
dl
rm
Archive::Zip::MemberRead.3pm
6734
0444
edit
dl
rm
Archive::Zip::Tree.3pm
2875
0444
edit
dl
rm
B::COW.3pm
5163
0444
edit
dl
rm
Canary::Stability.3pm
3727
0444
edit
dl
rm
CDB_File.3pm
14318
0444
edit
dl
rm
common::sense.3pm
0
0444
edit
dl
rm
Compress::Raw::Bzip2.3pm
13463
0444
edit
dl
rm
Compress::Raw::Zlib.3pm
42082
0444
edit
dl
rm
Compress::Zlib.3pm
38719
0444
edit
dl
rm
CPAN::Meta.3pm
15923
0444
edit
dl
rm
CPAN::Meta::Converter.3pm
6594
0444
edit
dl
rm
CPAN::Meta::Feature.3pm
4322
0444
edit
dl
rm
CPAN::Meta::History.3pm
7855
0444
edit
dl
rm
CPAN::Meta::History::Meta_1_0.3pm
9973
0444
edit
dl
rm
CPAN::Meta::History::Meta_1_1.3pm
12410
0444
edit
dl
rm
CPAN::Meta::History::Meta_1_2.3pm
22224
0444
edit
dl
rm
CPAN::Meta::History::Meta_1_3.3pm
23974
0444
edit
dl
rm
CPAN::Meta::History::Meta_1_4.3pm
24565
0444
edit
dl
rm
CPAN::Meta::Merge.3pm
5285
0444
edit
dl
rm
CPAN::Meta::Prereqs.3pm
7380
0444
edit
dl
rm
CPAN::Meta::Requirements.3pm
12308
0444
edit
dl
rm
CPAN::Meta::Spec.3pm
45592
0444
edit
dl
rm
CPAN::Meta::Validator.3pm
4215
0444
edit
dl
rm
CPAN::Meta::YAML.3pm
4230
0444
edit
dl
rm
Crypt::OpenSSL::Random.3pm
5634
0444
edit
dl
rm
Curses.3pm
37580
0444
edit
dl
rm
Curses::UI.3pm
15619
0444
edit
dl
rm
Curses::UI::Buttonbox.3pm
8908
0444
edit
dl
rm
Curses::UI::Calendar.3pm
8203
0444
edit
dl
rm
Curses::UI::Checkbox.3pm
6509
0444
edit
dl
rm
Curses::UI::Color.3pm
5903
0444
edit
dl
rm
Curses::UI::Common.3pm
6498
0444
edit
dl
rm
Curses::UI::Container.3pm
9041
0444
edit
dl
rm
Curses::UI::Dialog::Basic.3pm
5213
0444
edit
dl
rm
Curses::UI::Dialog::Calendar.3pm
4761
0444
edit
dl
rm
Curses::UI::Dialog::Dirbrowser.3pm
5369
0444
edit
dl
rm
Curses::UI::Dialog::Error.3pm
4307
0444
edit
dl
rm
Curses::UI::Dialog::Filebrowser.3pm
6889
0444
edit
dl
rm
Curses::UI::Dialog::Progress.3pm
5774
0444
edit
dl
rm
Curses::UI::Dialog::Question.3pm
5277
0444
edit
dl
rm
Curses::UI::Dialog::Status.3pm
4765
0444
edit
dl
rm
Curses::UI::Label.3pm
7333
0444
edit
dl
rm
Curses::UI::Listbox.3pm
11988
0444
edit
dl
rm
Curses::UI::Menubar.3pm
8110
0444
edit
dl
rm
Curses::UI::Notebook.3pm
9140
0444
edit
dl
rm
Curses::UI::PasswordEntry.3pm
3743
0444
edit
dl
rm
Curses::UI::Popupmenu.3pm
7431
0444
edit
dl
rm
Curses::UI::Progressbar.3pm
5891
0444
edit
dl
rm
Curses::UI::Radiobuttonbox.3pm
4069
0444
edit
dl
rm
Curses::UI::Searchable.3pm
6668
0444
edit
dl
rm
Curses::UI::TextEditor.3pm
14171
0444
edit
dl
rm
Curses::UI::TextEntry.3pm
3623
0444
edit
dl
rm
Curses::UI::TextViewer.3pm
3670
0444
edit
dl
rm
Curses::UI::Tutorial.3pm
8555
0444
edit
dl
rm
Curses::UI::Widget.3pm
25675
0444
edit
dl
rm
Curses::UI::Window.3pm
5084
0444
edit
dl
rm
Cwd.3pm
7183
0444
edit
dl
rm
Date::Format.3pm
7291
0444
edit
dl
rm
Date::Language.3pm
3809
0444
edit
dl
rm
Date::Language::Bulgarian.3pm
3675
0444
edit
dl
rm
Date::Language::Hungarian.3pm
3091
0444
edit
dl
rm
Date::Parse.3pm
5402
0444
edit
dl
rm
Digest::SHA.3pm
25759
0444
edit
dl
rm
Expect.3pm
60229
0444
edit
dl
rm
ExtUtils::CBuilder.3pm
11923
0444
edit
dl
rm
ExtUtils::CBuilder::Platform::Windows.3pm
3117
0444
edit
dl
rm
ExtUtils::Command.3pm
5942
0444
edit
dl
rm
ExtUtils::Command::MM.3pm
5723
0444
edit
dl
rm
ExtUtils::Liblist.3pm
12679
0444
edit
dl
rm
ExtUtils::MakeMaker.3pm
79357
0444
edit
dl
rm
ExtUtils::MakeMaker::Config.3pm
2587
0444
edit
dl
rm
ExtUtils::MakeMaker::FAQ.3pm
26829
0444
edit
dl
rm
ExtUtils::MakeMaker::Locale.3pm
11168
0444
edit
dl
rm
ExtUtils::MakeMaker::Tutorial.3pm
8389
0444
edit
dl
rm
ExtUtils::Manifest.3pm
11961
0444
edit
dl
rm
ExtUtils::Mkbootstrap.3pm
3459
0444
edit
dl
rm
ExtUtils::Mksymlists.3pm
6699
0444
edit
dl
rm
ExtUtils::MM.3pm
2829
0444
edit
dl
rm
ExtUtils::MM_AIX.3pm
3044
0444
edit
dl
rm
ExtUtils::MM_Any.3pm
31129
0444
edit
dl
rm
ExtUtils::MM_BeOS.3pm
2798
0444
edit
dl
rm
ExtUtils::MM_Cygwin.3pm
3569
0444
edit
dl
rm
ExtUtils::MM_Darwin.3pm
2688
0444
edit
dl
rm
ExtUtils::MM_DOS.3pm
3021
0444
edit
dl
rm
ExtUtils::MM_MacOS.3pm
2987
0444
edit
dl
rm
ExtUtils::MM_NW5.3pm
3200
0444
edit
dl
rm
ExtUtils::MM_OS2.3pm
2886
0444
edit
dl
rm
ExtUtils::MM_QNX.3pm
2942
0444
edit
dl
rm
ExtUtils::MM_Unix.3pm
21419
0444
edit
dl
rm
ExtUtils::MM_UWIN.3pm
3051
0444
edit
dl
rm
ExtUtils::MM_VMS.3pm
14900
0444
edit
dl
rm
ExtUtils::MM_VOS.3pm
2926
0444
edit
dl
rm
ExtUtils::MM_Win32.3pm
5919
0444
edit
dl
rm
ExtUtils::MM_Win95.3pm
3276
0444
edit
dl
rm
ExtUtils::MY.3pm
2764
0444
edit
dl
rm
ExtUtils::testlib.3pm
2690
0444
edit
dl
rm
File::GlobMapper.3pm
11447
0444
edit
dl
rm
File::HomeDir.3pm
18212
0444
edit
dl
rm
File::HomeDir::Darwin.3pm
3232
0444
edit
dl
rm
File::HomeDir::Darwin::Carbon.3pm
3517
0444
edit
dl
rm
File::HomeDir::Darwin::Cocoa.3pm
3446
0444
edit
dl
rm
File::HomeDir::Driver.3pm
3101
0444
edit
dl
rm
File::HomeDir::FreeDesktop.3pm
3487
0444
edit
dl
rm
File::HomeDir::MacOS9.3pm
3499
0444
edit
dl
rm
File::HomeDir::Test.3pm
3534
0444
edit
dl
rm
File::HomeDir::Unix.3pm
3638
0444
edit
dl
rm
File::HomeDir::Windows.3pm
4891
0444
edit
dl
rm
File::Path.3pm
31030
0444
edit
dl
rm
File::Slurp.3pm
23626
0444
edit
dl
rm
File::Spec.3pm
13784
0444
edit
dl
rm
File::Spec::AmigaOS.3pm
2826
0444
edit
dl
rm
File::Spec::Cygwin.3pm
3957
0444
edit
dl
rm
File::Spec::Epoc.3pm
3251
0444
edit
dl
rm
File::Spec::Functions.3pm
3799
0444
edit
dl
rm
File::Spec::Mac.3pm
18664
0444
edit
dl
rm
File::Spec::OS2.3pm
3118
0444
edit
dl
rm
File::Spec::Unix.3pm
9837
0444
edit
dl
rm
File::Spec::VMS.3pm
6389
0444
edit
dl
rm
File::Spec::Win32.3pm
6451
0444
edit
dl
rm
File::Temp.3pm
36799
0444
edit
dl
rm
File::Which.3pm
9746
0444
edit
dl
rm
Getopt::Long.3pm
52647
0444
edit
dl
rm
HDB.3pm
10947
0444
edit
dl
rm
HDB::CMDS.3pm
18894
0444
edit
dl
rm
HDB::Encode.3pm
7863
0444
edit
dl
rm
HDB::Object.3pm
10057
0444
edit
dl
rm
HTML::AsSubs.3pm
8586
0444
edit
dl
rm
HTML::Element.3pm
70793
0444
edit
dl
rm
HTML::Element::traverse.3pm
15984
0444
edit
dl
rm
HTML::Form.3pm
28158
0444
edit
dl
rm
HTML::Parse.3pm
8277
0444
edit
dl
rm
HTML::Tree.3pm
9982
0444
edit
dl
rm
HTML::Tree::AboutObjects.3pm
37918
0444
edit
dl
rm
HTML::Tree::AboutTrees.3pm
58534
0444
edit
dl
rm
HTML::Tree::Scanning.3pm
34385
0444
edit
dl
rm
HTML::TreeBuilder.3pm
30138
0444
edit
dl
rm
HTTP::Tiny.3pm
27709
0444
edit
dl
rm
IO::AtomicFile.3pm
5381
0444
edit
dl
rm
IO::Compress::Base.3pm
3506
0444
edit
dl
rm
IO::Compress::Bzip2.3pm
23260
0444
edit
dl
rm
IO::Compress::Deflate.3pm
26768
0444
edit
dl
rm
IO::Compress::FAQ.3pm
26718
0444
edit
dl
rm
IO::Compress::Gzip.3pm
34489
0444
edit
dl
rm
IO::Compress::RawDeflate.3pm
27134
0444
edit
dl
rm
IO::Compress::Zip.3pm
40870
0444
edit
dl
rm
IO::InnerFile.3pm
6035
0444
edit
dl
rm
IO::Lines.3pm
3783
0444
edit
dl
rm
IO::Pty.3pm
8579
0444
edit
dl
rm
IO::Scalar.3pm
10679
0444
edit
dl
rm
IO::ScalarArray.3pm
10528
0444
edit
dl
rm
IO::Stringy.3pm
4049
0444
edit
dl
rm
IO::Tty.3pm
8348
0444
edit
dl
rm
IO::Tty::Constant.3pm
10012
0444
edit
dl
rm
IO::Uncompress::AnyInflate.3pm
32800
0444
edit
dl
rm
IO::Uncompress::AnyUncompress.3pm
30767
0444
edit
dl
rm
IO::Uncompress::Base.3pm
3518
0444
edit
dl
rm
IO::Uncompress::Bunzip2.3pm
29171
0444
edit
dl
rm
IO::Uncompress::Gunzip.3pm
31719
0444
edit
dl
rm
IO::Uncompress::Inflate.3pm
29915
0444
edit
dl
rm
IO::Uncompress::RawInflate.3pm
29563
0444
edit
dl
rm
IO::Uncompress::Unzip.3pm
31279
0444
edit
dl
rm
IO::Wrap.3pm
10664
0444
edit
dl
rm
IO::WrapTie.3pm
14987
0444
edit
dl
rm
JSON::PP.3pm
50080
0444
edit
dl
rm
JSON::PP::Boolean.3pm
2667
0444
edit
dl
rm
JSON::Syck.3pm
8094
0444
edit
dl
rm
JSON::XS.3pm
89037
0444
edit
dl
rm
JSON::XS::Boolean.3pm
2857
0444
edit
dl
rm
lib::core::only.3pm
5647
0444
edit
dl
rm
local::lib.3pm
31390
0444
edit
dl
rm
LWP.3pm
28506
0444
edit
dl
rm
LWP::Authen::Ntlm.3pm
7489
0444
edit
dl
rm
LWP::ConnCache.3pm
9967
0444
edit
dl
rm
LWP::Debug.3pm
5608
0444
edit
dl
rm
LWP::MemberMixin.3pm
4821
0444
edit
dl
rm
LWP::Protocol.3pm
8350
0444
edit
dl
rm
LWP::Protocol::https.3pm
5684
0444
edit
dl
rm
LWP::RobotUA.3pm
9022
0444
edit
dl
rm
LWP::Simple.3pm
9016
0444
edit
dl
rm
LWP::UserAgent.3pm
48156
0444
edit
dl
rm
lwpcook.3pm
14838
0444
edit
dl
rm
lwptut.3pm
32441
0444
edit
dl
rm
Module::Build.3pm
44563
0444
edit
dl
rm
Module::Build::API.3pm
89267
0444
edit
dl
rm
Module::Build::Authoring.3pm
17363
0444
edit
dl
rm
Module::Build::Base.3pm
5157
0444
edit
dl
rm
Module::Build::Bundling.3pm
9999
0444
edit
dl
rm
Module::Build::Compat.3pm
10885
0444
edit
dl
rm
Module::Build::ConfigData.3pm
7388
0444
edit
dl
rm
Module::Build::Cookbook.3pm
25946
0444
edit
dl
rm
Module::Build::Notes.3pm
4690
0444
edit
dl
rm
Module::Build::Platform::aix.3pm
4472
0444
edit
dl
rm
Module::Build::Platform::cygwin.3pm
4505
0444
edit
dl
rm
Module::Build::Platform::darwin.3pm
4491
0444
edit
dl
rm
Module::Build::Platform::Default.3pm
4490
0444
edit
dl
rm
Module::Build::Platform::MacOS.3pm
5398
0444
edit
dl
rm
Module::Build::Platform::os2.3pm
4474
0444
edit
dl
rm
Module::Build::Platform::Unix.3pm
4481
0444
edit
dl
rm
Module::Build::Platform::VMS.3pm
7885
0444
edit
dl
rm
Module::Build::Platform::VOS.3pm
4477
0444
edit
dl
rm
Module::Build::Platform::Windows.3pm
4529
0444
edit
dl
rm
Module::Build::PPMMaker.3pm
4886
0444
edit
dl
rm
Mozilla::CA.3pm
3571
0444
edit
dl
rm
Net::CIDR::Lite.3pm
9562
0444
edit
dl
rm
Net::Cmd.3pm
11545
0444
edit
dl
rm
Net::Config.3pm
8100
0444
edit
dl
rm
Net::Domain.3pm
3835
0444
edit
dl
rm
Net::FTP.3pm
27341
0444
edit
dl
rm
Net::FTP::dataconn.3pm
3979
0444
edit
dl
rm
Net::HTTP.3pm
16375
0444
edit
dl
rm
Net::HTTP::NB.3pm
5394
0444
edit
dl
rm
Net::HTTPS.3pm
5438
0444
edit
dl
rm
Net::IP.3pm
27697
0444
edit
dl
rm
Net::libnetFAQ.3pm
14746
0444
edit
dl
rm
Net::Netrc.3pm
6729
0444
edit
dl
rm
Net::NNTP.3pm
23193
0444
edit
dl
rm
Net::POP3.3pm
12259
0444
edit
dl
rm
Net::SMTP.3pm
18880
0444
edit
dl
rm
Net::SSLeay.3pm
349350
0444
edit
dl
rm
Net::SSLeay::Handle.3pm
9127
0444
edit
dl
rm
Net::Time.3pm
4524
0444
edit
dl
rm
ok.3pm
2851
0444
edit
dl
rm
Parse::CPAN::Meta.3pm
10187
0444
edit
dl
rm
POD2::DE::local::lib.3pm
22879
0444
edit
dl
rm
POD2::PT_BR::local::lib.3pm
22762
0444
edit
dl
rm
Socket.3pm
34078
0444
edit
dl
rm
Sub::Identify.3pm
5087
0444
edit
dl
rm
SUPER.3pm
7394
0444
edit
dl
rm
Switch.3pm
19014
0444
edit
dl
rm
TAP::Base.3pm
3401
0444
edit
dl
rm
TAP::Formatter::Base.3pm
6233
0444
edit
dl
rm
TAP::Formatter::Color.3pm
3717
0444
edit
dl
rm
TAP::Formatter::Console.3pm
2722
0444
edit
dl
rm
TAP::Formatter::Console::ParallelSession.3pm
3065
0444
edit
dl
rm
TAP::Formatter::Console::Session.3pm
2832
0444
edit
dl
rm
TAP::Formatter::File.3pm
2693
0444
edit
dl
rm
TAP::Formatter::File::Session.3pm
2847
0444
edit
dl
rm
TAP::Formatter::Session.3pm
3603
0444
edit
dl
rm
TAP::Harness.3pm
21300
0444
edit
dl
rm
TAP::Harness::Beyond.3pm
19118
0444
edit
dl
rm
TAP::Harness::Env.3pm
5467
0444
edit
dl
rm
TAP::Object.3pm
4497
0444
edit
dl
rm
TAP::Parser.3pm
42210
0444
edit
dl
rm
TAP::Parser::Aggregator.3pm
8023
0444
edit
dl
rm
TAP::Parser::Grammar.3pm
8647
0444
edit
dl
rm
TAP::Parser::Iterator.3pm
4993
0444
edit
dl
rm
TAP::Parser::Iterator::Array.3pm
3771
0444
edit
dl
rm
TAP::Parser::Iterator::Process.3pm
4601
0444
edit
dl
rm
TAP::Parser::Iterator::Stream.3pm
3712
0444
edit
dl
rm
TAP::Parser::IteratorFactory.3pm
6904
0444
edit
dl
rm
TAP::Parser::Multiplexer.3pm
4646
0444
edit
dl
rm
TAP::Parser::Result.3pm
7512
0444
edit
dl
rm
TAP::Parser::Result::Bailout.3pm
3293
0444
edit
dl
rm
TAP::Parser::Result::Comment.3pm
3118
0444
edit
dl
rm
TAP::Parser::Result::Plan.3pm
4173
0444
edit
dl
rm
TAP::Parser::Result::Pragma.3pm
3073
0444
edit
dl
rm
TAP::Parser::Result::Test.3pm
7114
0444
edit
dl
rm
TAP::Parser::Result::Unknown.3pm
2973
0444
edit
dl
rm
TAP::Parser::Result::Version.3pm
3154
0444
edit
dl
rm
TAP::Parser::Result::YAML.3pm
3086
0444
edit
dl
rm
TAP::Parser::ResultFactory.3pm
5523
0444
edit
dl
rm
TAP::Parser::Scheduler.3pm
8113
0444
edit
dl
rm
TAP::Parser::Scheduler::Job.3pm
4301
0444
edit
dl
rm
TAP::Parser::Scheduler::Spinner.3pm
3346
0444
edit
dl
rm
TAP::Parser::Source.3pm
8170
0444
edit
dl
rm
TAP::Parser::SourceHandler.3pm
7559
0444
edit
dl
rm
TAP::Parser::SourceHandler::Executable.3pm
5297
0444
edit
dl
rm
TAP::Parser::SourceHandler::File.3pm
4567
0444
edit
dl
rm
TAP::Parser::SourceHandler::Handle.3pm
4425
0444
edit
dl
rm
TAP::Parser::SourceHandler::Perl.3pm
6262
0444
edit
dl
rm
TAP::Parser::SourceHandler::RawTAP.3pm
4434
0444
edit
dl
rm
TAP::Parser::YAMLish::Reader.3pm
3995
0444
edit
dl
rm
TAP::Parser::YAMLish::Writer.3pm
4879
0444
edit
dl
rm
Template.3pm
27909
0444
edit
dl
rm
Template::Base.3pm
8149
0444
edit
dl
rm
Template::Config.3pm
8687
0444
edit
dl
rm
Template::Constants.3pm
7815
0444
edit
dl
rm
Template::Context.3pm
26637
0444
edit
dl
rm
Template::Directive.3pm
4821
0444
edit
dl
rm
Template::Document.3pm
11829
0444
edit
dl
rm
Template::Exception.3pm
6763
0444
edit
dl
rm
Template::FAQ.3pm
14564
0444
edit
dl
rm
Template::Filters.3pm
9817
0444
edit
dl
rm
Template::Grammar.3pm
5039
0444
edit
dl
rm
Template::Iterator.3pm
11413
0444
edit
dl
rm
Template::Manual.3pm
6317
0444
edit
dl
rm
Template::Manual::Config.3pm
79504
0444
edit
dl
rm
Template::Manual::Credits.3pm
8246
0444
edit
dl
rm
Template::Manual::Directives.3pm
77293
0444
edit
dl
rm
Template::Manual::Filters.3pm
20810
0444
edit
dl
rm
Template::Manual::Internals.3pm
23433
0444
edit
dl
rm
Template::Manual::Intro.3pm
14092
0444
edit
dl
rm
Template::Manual::Plugins.3pm
13780
0444
edit
dl
rm
Template::Manual::Syntax.3pm
14549
0444
edit
dl
rm
Template::Manual::Variables.3pm
33110
0444
edit
dl
rm
Template::Manual::Views.3pm
25953
0444
edit
dl
rm
Template::Manual::VMethods.3pm
28195
0444
edit
dl
rm
Template::Modules.3pm
9827
0444
edit
dl
rm
Template::Namespace::Constants.3pm
6002
0444
edit
dl
rm
Template::Parser.3pm
9917
0444
edit
dl
rm
Template::Plugin.3pm
10937
0444
edit
dl
rm
Template::Plugin::Assert.3pm
5446
0444
edit
dl
rm
Template::Plugin::CGI.3pm
6188
0444
edit
dl
rm
Template::Plugin::Datafile.3pm
6601
0444
edit
dl
rm
Template::Plugin::Date.3pm
9538
0444
edit
dl
rm
Template::Plugin::Directory.3pm
11979
0444
edit
dl
rm
Template::Plugin::Dumper.3pm
6078
0444
edit
dl
rm
Template::Plugin::File.3pm
13009
0444
edit
dl
rm
Template::Plugin::Filter.3pm
12936
0444
edit
dl
rm
Template::Plugin::Format.3pm
4895
0444
edit
dl
rm
Template::Plugin::HTML.3pm
7823
0444
edit
dl
rm
Template::Plugin::Image.3pm
11950
0444
edit
dl
rm
Template::Plugin::Iterator.3pm
5061
0444
edit
dl
rm
Template::Plugin::Math.3pm
6623
0444
edit
dl
rm
Template::Plugin::Pod.3pm
4784
0444
edit
dl
rm
Template::Plugin::Procedural.3pm
5631
0444
edit
dl
rm
Template::Plugin::Scalar.3pm
5032
0444
edit
dl
rm
Template::Plugin::String.3pm
17263
0444
edit
dl
rm
Template::Plugin::Table.3pm
11145
0444
edit
dl
rm
Template::Plugin::URL.3pm
8080
0444
edit
dl
rm
Template::Plugin::View.3pm
5479
0444
edit
dl
rm
Template::Plugin::Wrap.3pm
6433
0444
edit
dl
rm
Template::Plugins.3pm
9733
0444
edit
dl
rm
Template::Provider.3pm
14678
0444
edit
dl
rm
Template::Service.3pm
14813
0444
edit
dl
rm
Template::Stash.3pm
11983
0444
edit
dl
rm
Template::Stash::Context.3pm
7130
0444
edit
dl
rm
Template::Stash::XS.3pm
6644
0444
edit
dl
rm
Template::Test.3pm
15524
0444
edit
dl
rm
Template::Toolkit.3pm
9227
0444
edit
dl
rm
Template::Tools.3pm
5001
0444
edit
dl
rm
Template::Tools::tpage.3pm
5806
0444
edit
dl
rm
Template::Tools::ttree.3pm
16567
0444
edit
dl
rm
Template::Tutorial.3pm
4566
0444
edit
dl
rm
Template::Tutorial::Datafile.3pm
19539
0444
edit
dl
rm
Template::Tutorial::Web.3pm
34118
0444
edit
dl
rm
Template::View.3pm
12618
0444
edit
dl
rm
Template::VMethods.3pm
4688
0444
edit
dl
rm
Term::ReadKey.3pm
13029
0444
edit
dl
rm
Test2.3pm
9556
0444
edit
dl
rm
Test2::API.3pm
30424
0444
edit
dl
rm
Test2::API::Breakage.3pm
4988
0444
edit
dl
rm
Test2::API::Context.3pm
17574
0444
edit
dl
rm
Test2::API::Instance.3pm
12404
0444
edit
dl
rm
Test2::API::Stack.3pm
6568
0444
edit
dl
rm
Test2::Event.3pm
9189
0444
edit
dl
rm
Test2::Event::Bail.3pm
3470
0444
edit
dl
rm
Test2::Event::Diag.3pm
3338
0444
edit
dl
rm
Test2::Event::Exception.3pm
3520
0444
edit
dl
rm
Test2::Event::Generic.3pm
7662
0444
edit
dl
rm
Test2::Event::Info.3pm
4261
0444
edit
dl
rm
Test2::Event::Note.3pm
3323
0444
edit
dl
rm
Test2::Event::Ok.3pm
4255
0444
edit
dl
rm
Test2::Event::Plan.3pm
3907
0444
edit
dl
rm
Test2::Event::Skip.3pm
3665
0444
edit
dl
rm
Test2::Event::Subtest.3pm
3573
0444
edit
dl
rm
Test2::Event::Waiting.3pm
3107
0444
edit
dl
rm
Test2::Formatter.3pm
5208
0444
edit
dl
rm
Test2::Formatter::TAP.3pm
9255
0444
edit
dl
rm
Test2::Hub.3pm
16755
0444
edit
dl
rm
Test2::Hub::Interceptor.3pm
2937
0444
edit
dl
rm
Test2::Hub::Interceptor::Terminator.3pm
2980
0444
edit
dl
rm
Test2::Hub::Subtest.3pm
3803
0444
edit
dl
rm
Test2::IPC.3pm
3324
0444
edit
dl
rm
Test2::IPC::Driver.3pm
9512
0444
edit
dl
rm
Test2::IPC::Driver::Files.3pm
3822
0444
edit
dl
rm
Test2::Transition.3pm
18406
0444
edit
dl
rm
Test2::Util.3pm
5123
0444
edit
dl
rm
Test2::Util::ExternalMeta.3pm
5594
0444
edit
dl
rm
Test2::Util::HashBase.3pm
7463
0444
edit
dl
rm
Test2::Util::Trace.3pm
5577
0444
edit
dl
rm
Test::Builder.3pm
26915
0444
edit
dl
rm
Test::Builder::Formatter.3pm
3656
0444
edit
dl
rm
Test::Builder::IO::Scalar.3pm
9740
0444
edit
dl
rm
Test::Builder::Module.3pm
5567
0444
edit
dl
rm
Test::Builder::Tester.3pm
11550
0444
edit
dl
rm
Test::Builder::Tester::Color.3pm
3131
0444
edit
dl
rm
Test::Builder::TodoDiag.3pm
3129
0444
edit
dl
rm
Test::Fatal.3pm
9303
0444
edit
dl
rm
Test::HACKING.3pm
9253
0444
edit
dl
rm
Test::Harness.3pm
11028
0444
edit
dl
rm
Test::LeakTrace.3pm
10022
0444
edit
dl
rm
Test::LeakTrace::JA.3pm
12328
0444
edit
dl
rm
Test::LeakTrace::Script.3pm
5140
0444
edit
dl
rm
Test::MockModule.3pm
10818
0444
edit
dl
rm
Test::More.3pm
43215
0444
edit
dl
rm
Test::More::UTF8.3pm
3602
0444
edit
dl
rm
Test::RequiresInternet.3pm
3944
0444
edit
dl
rm
Test::Simple.3pm
9119
0444
edit
dl
rm
Test::Tester.3pm
15781
0444
edit
dl
rm
Test::Tester::Capture.3pm
2902
0444
edit
dl
rm
Test::Tester::CaptureRunner.3pm
2673
0444
edit
dl
rm
Test::Tutorial.3pm
24261
0444
edit
dl
rm
Test::use::ok.3pm
3841
0444
edit
dl
rm
Test::Warnings.3pm
14231
0444
edit
dl
rm
Text::Glob.3pm
6106
0444
edit
dl
rm
Text::Template.3pm
65499
0444
edit
dl
rm
Text::Template::Preprocess.3pm
6270
0444
edit
dl
rm
Time::Zone.3pm
3413
0444
edit
dl
rm
TimeDate.3pm
2397
0444
edit
dl
rm
Try::Tiny.3pm
20343
0444
edit
dl
rm
Types::Serialiser.3pm
11473
0444
edit
dl
rm
Types::Serialiser::Error.3pm
2705
0444
edit
dl
rm
version.3pm
13937
0444
edit
dl
rm
version::Internals.3pm
30287
0444
edit
dl
rm
WWW::Mechanize.3pm
68196
0444
edit
dl
rm
WWW::Mechanize::Cookbook.3pm
7159
0444
edit
dl
rm
WWW::Mechanize::Examples.3pm
22490
0444
edit
dl
rm
WWW::Mechanize::FAQ.3pm
24359
0444
edit
dl
rm
WWW::Mechanize::Image.3pm
6490
0444
edit
dl
rm
WWW::Mechanize::Link.3pm
6518
0444
edit
dl
rm
XML::NamespaceSupport.3pm
13052
0444
edit
dl
rm
XML::Parser.3pm
26296
0444
edit
dl
rm
XML::Parser::Expat.3pm
26799
0444
edit
dl
rm
XML::Parser::Style::Debug.3pm
4408
0444
edit
dl
rm
XML::Parser::Style::Objects.3pm
4888
0444
edit
dl
rm
XML::Parser::Style::Stream.3pm
5925
0444
edit
dl
rm
XML::Parser::Style::Subs.3pm
4863
0444
edit
dl
rm
XML::Parser::Style::Tree.3pm
5529
0444
edit
dl
rm
XML::SAX.3pm
9229
0444
edit
dl
rm
XML::SAX::Base.3pm
13704
0444
edit
dl
rm
XML::SAX::BuildSAXBase.3pm
13700
0444
edit
dl
rm
XML::SAX::DocumentLocator.3pm
5239
0444
edit
dl
rm
XML::SAX::Exception.3pm
5622
0444
edit
dl
rm
XML::SAX::Expat.3pm
6404
0444
edit
dl
rm
XML::SAX::Intro.3pm
20220
0444
edit
dl
rm
XML::SAX::ParserFactory.3pm
7919
0444
edit
dl
rm
XML::SAX::PurePerl.3pm
6172
0444
edit
dl
rm
XML::SAX::PurePerl::Reader.3pm
4103
0444
edit
dl
rm
XML::Simple.3pm
65589
0444
edit
dl
rm
XML::Simple::FAQ.3pm
27223
0444
edit
dl
rm
YAML.3pm
29980
0444
edit
dl
rm
YAML::Any.3pm
7487
0444
edit
dl
rm
YAML::Dumper.3pm
4776
0444
edit
dl
rm
YAML::Dumper::Base.3pm
4642
0444
edit
dl
rm
YAML::Error.3pm
4681
0444
edit
dl
rm
YAML::Loader.3pm
4766
0444
edit
dl
rm
YAML::Loader::Base.3pm
4642
0444
edit
dl
rm
YAML::Marshall.3pm
4640
0444
edit
dl
rm
YAML::Node.3pm
6743
0444
edit
dl
rm
YAML::Syck.3pm
10806
0444
edit
dl
rm
YAML::Tag.3pm
4499
0444
edit
dl
rm
YAML::Types.3pm
4716
0444
edit
dl
rm
Edit:
/usr/local/share/man/man3/HTML::Tree::Scanning.3pm
(34385B)
.\" Automatically generated by Pod::Man 2.27 (Pod::Simple 3.28) .\" .\" Standard preamble: .\" ======================================================================== .de Sp \" Vertical space (when we can't use .PP) .if t .sp .5v .if n .sp .. .de Vb \" Begin verbatim text .ft CW .nf .ne \\$1 .. .de Ve \" End verbatim text .ft R .fi .. .\" Set up some character translations and predefined strings. \*(-- will .\" give an unbreakable dash, \*(PI will give pi, \*(L" will give a left .\" double quote, and \*(R" will give a right double quote. \*(C+ will .\" give a nicer C++. Capital omega is used to do unbreakable dashes and .\" therefore won't be available. \*(C` and \*(C' expand to `' in nroff, .\" nothing in troff, for use with C<>. .tr \(*W- .ds C+ C\v'-.1v'\h'-1p'\s-2+\h'-1p'+\s0\v'.1v'\h'-1p' .ie n \{\ . ds -- \(*W- . ds PI pi . if (\n(.H=4u)&(1m=24u) .ds -- \(*W\h'-12u'\(*W\h'-12u'-\" diablo 10 pitch . if (\n(.H=4u)&(1m=20u) .ds -- \(*W\h'-12u'\(*W\h'-8u'-\" diablo 12 pitch . ds L" "" . ds R" "" . ds C` "" . ds C' "" 'br\} .el\{\ . ds -- \|\(em\| . ds PI \(*p . ds L" `` . ds R" '' . ds C` . ds C' 'br\} .\" .\" Escape single quotes in literal strings from groff's Unicode transform. .ie \n(.g .ds Aq \(aq .el .ds Aq ' .\" .\" If the F register is turned on, we'll generate index entries on stderr for .\" titles (.TH), headers (.SH), subsections (.SS), items (.Ip), and index .\" entries marked with X<> in POD. Of course, you'll have to process the .\" output yourself in some meaningful fashion. .\" .\" Avoid warning from groff about undefined register 'F'. .de IX .. .nr rF 0 .if \n(.g .if rF .nr rF 1 .if (\n(rF:(\n(.g==0)) \{ . if \nF \{ . de IX . tm Index:\\$1\t\\n%\t"\\$2" .. . if !\nF==2 \{ . nr % 0 . nr F 2 . \} . \} .\} .rr rF .\" .\" Accent mark definitions (@(#)ms.acc 1.5 88/02/08 SMI; from UCB 4.2). .\" Fear. Run. Save yourself. No user-serviceable parts. . \" fudge factors for nroff and troff .if n \{\ . ds #H 0 . ds #V .8m . ds #F .3m . ds #[ \f1 . ds #] \fP .\} .if t \{\ . ds #H ((1u-(\\\\n(.fu%2u))*.13m) . ds #V .6m . ds #F 0 . ds #[ \& . ds #] \& .\} . \" simple accents for nroff and troff .if n \{\ . ds ' \& . ds ` \& . ds ^ \& . ds , \& . ds ~ ~ . ds / .\} .if t \{\ . ds ' \\k:\h'-(\\n(.wu*8/10-\*(#H)'\'\h"|\\n:u" . ds ` \\k:\h'-(\\n(.wu*8/10-\*(#H)'\`\h'|\\n:u' . ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'^\h'|\\n:u' . ds , \\k:\h'-(\\n(.wu*8/10)',\h'|\\n:u' . ds ~ \\k:\h'-(\\n(.wu-\*(#H-.1m)'~\h'|\\n:u' . ds / \\k:\h'-(\\n(.wu*8/10-\*(#H)'\z\(sl\h'|\\n:u' .\} . \" troff and (daisy-wheel) nroff accents .ds : \\k:\h'-(\\n(.wu*8/10-\*(#H+.1m+\*(#F)'\v'-\*(#V'\z.\h'.2m+\*(#F'.\h'|\\n:u'\v'\*(#V' .ds 8 \h'\*(#H'\(*b\h'-\*(#H' .ds o \\k:\h'-(\\n(.wu+\w'\(de'u-\*(#H)/2u'\v'-.3n'\*(#[\z\(de\v'.3n'\h'|\\n:u'\*(#] .ds d- \h'\*(#H'\(pd\h'-\w'~'u'\v'-.25m'\f2\(hy\fP\v'.25m'\h'-\*(#H' .ds D- D\\k:\h'-\w'D'u'\v'-.11m'\z\(hy\v'.11m'\h'|\\n:u' .ds th \*(#[\v'.3m'\s+1I\s-1\v'-.3m'\h'-(\w'I'u*2/3)'\s-1o\s+1\*(#] .ds Th \*(#[\s+2I\s-2\h'-\w'I'u*3/5'\v'-.3m'o\v'.3m'\*(#] .ds ae a\h'-(\w'a'u*4/10)'e .ds Ae A\h'-(\w'A'u*4/10)'E . \" corrections for vroff .if v .ds ~ \\k:\h'-(\\n(.wu*9/10-\*(#H)'\s-2\u~\d\s+2\h'|\\n:u' .if v .ds ^ \\k:\h'-(\\n(.wu*10/11-\*(#H)'\v'-.4m'^\v'.4m'\h'|\\n:u' . \" for low resolution devices (crt and lpr) .if \n(.H>23 .if \n(.V>19 \ \{\ . ds : e . ds 8 ss . ds o a . ds d- d\h'-1'\(ga . ds D- D\h'-1'\(hy . ds th \o'bp' . ds Th \o'LP' . ds ae ae . ds Ae AE .\} .rm #[ #] #H #V #F C .\" ======================================================================== .\" .IX Title "HTML::Tree::Scanning 3" .TH HTML::Tree::Scanning 3 "2016-10-25" "perl v5.16.3" "User Contributed Perl Documentation" .\" For nroff, turn off justification. Always turn off hyphenation; it makes .\" way too many mistakes in technical documents. .if n .ad l .nh .SH "NAME" HTML::Tree::Scanning \-\- article: "Scanning HTML" .SH "SYNOPSIS" .IX Header "SYNOPSIS" .Vb 1 \& # This an article, not a module. .Ve .SH "DESCRIPTION" .IX Header "DESCRIPTION" The following article by Sean M. Burke first appeared in \fIThe Perl Journal\fR #19 and is copyright 2000 The Perl Journal. It appears courtesy of Jon Orwant and The Perl Journal. This document may be distributed under the same terms as Perl itself. .PP (Note that this is discussed in chapters 6 through 10 of the book \fIPerl and \s-1LWP\s0\fR <http://lwp.interglacial.com/> which was written after the following documentation, and which is available free online.) .SH "Scanning HTML" .IX Header "Scanning HTML" \&\-\- Sean M. Burke .PP In \fIThe Perl Journal\fR issue 17, Ken MacFarlane's article \*(L"Parsing \&\s-1HTML\s0 with HTML::Parser\*(R" describes how the HTML::Parser module scans \&\s-1HTML\s0 source as a stream of start-tags, end-tags, text, comments, etc. In \s-1TPJ\s0 #18, my \*(L"Trees\*(R" article kicked around the idea of tree-shaped data structures. Now I'll try to tie it together, in a discussion of \&\s-1HTML\s0 trees. .PP The \s-1CPAN\s0 module HTML::TreeBuilder takes the tags that HTML::Parser picks out, and builds a parse tree \*(-- a tree-shaped network of objects... .Sp .RS 4 Footnote: And if you need a quick explanation of objects, see my \s-1TPJ17\s0 article \*(L"A User's View of Object-Oriented Modules\*(R"; or go whole hog and get Damian Conway's excellent book \fIObject-Oriented Perl\fR, from Manning Publications. .RE .PP \&...representing the structured content of the \s-1HTML\s0 document. And once the document is parsed as a tree, you'll find the common tasks of extracting data from that \s-1HTML\s0 document/tree to be quite straightforward. .SS "HTML::Parser, HTML::TreeBuilder, and HTML::Element" .IX Subsection "HTML::Parser, HTML::TreeBuilder, and HTML::Element" You use HTML::TreeBuilder to make a parse tree out of an \s-1HTML\s0 source file, by simply saying: .PP .Vb 3 \& use HTML::TreeBuilder; \& my $tree = HTML::TreeBuilder\->new(); \& $tree\->parse_file(\*(Aqfoo.html\*(Aq); .Ve .PP and then \f(CW$tree\fR contains a parse tree built from the \s-1HTML\s0 source from the file \*(L"foo.html\*(R". The way this parse tree is represented is with a network of objects \*(-- \f(CW$tree\fR is the root, an element with tag-name \&\*(L"html\*(R", and its children typically include a \*(L"head\*(R" and \*(L"body\*(R" element, and so on. Elements in the tree are objects of the class HTML::Element. .PP So, if you take this source: .PP .Vb 4 \& <html><head><title>Doc 1</title></head> \& <body> \& Stuff <hr> 2000\-08\-17 \& </body></html> .Ve .PP and feed it to HTML::TreeBuilder, it'll return a tree of objects that looks like this: .PP .Vb 7 \& html \& / \e \& head body \& / / | \e \& title "Stuff" hr "2000\-08\-17" \& | \& "Doc 1" .Ve .PP This is a pretty simple document, but if it were any more complex, it'd be a bit hard to draw in that style, since it's sprawl left and right. The same tree can be represented a bit more easily sideways, with indenting: .PP .Vb 8 \& . html \& . head \& . title \& . "Doc 1" \& . body \& . "Stuff" \& . hr \& . "2000\-08\-17" .Ve .PP Either way expresses the same structure. In that structure, the root node is an object of the class HTML::Element .Sp .RS 4 Footnote: Well actually, the root is of the class HTML::TreeBuilder, but that's just a subclass of HTML::Element, plus the few extra methods like \&\f(CW\*(C`parse_file\*(C'\fR that elaborate the tree .RE .PP , with the tag name \*(L"html\*(R", and with two children: an HTML::Element object whose tag names are \*(L"head\*(R" and \*(L"body\*(R". And each of those elements have children, and so on down. Not all elements (as we'll call the objects of class HTML::Element) have children \*(-- the \*(L"hr\*(R" element doesn't. And note all nodes in the tree are elements \*(-- the text nodes (\*(L"Doc 1\*(R", \*(L"Stuff\*(R", and \*(L"2000\-08\-17\*(R") are just strings. .PP Objects of the class HTML::Element each have three noteworthy attributes: .ie n .IP """_tag"" \*(-- (best accessed as ""$e\->tag"") this element's tag-name, lowercased (e.g., ""em"" for an ""em"" element)." 4 .el .IP "\f(CW_tag\fR \*(-- (best accessed as \f(CW$e\->tag\fR) this element's tag-name, lowercased (e.g., ``em'' for an ``em'' element)." 4 .IX Item "_tag (best accessed as $e->tag) this element's tag-name, lowercased (e.g., em for an em element)." .RS 4 .RS 4 Footnote: Yes, this is misnamed. In proper \s-1SGML\s0 terminology, this is instead called a \*(L"\s-1GI\*(R",\s0 short for \*(L"generic identifier\*(R"; and the term \&\*(L"tag\*(R" is used for a token of \s-1SGML\s0 source that represents either the start of an element (a start-tag like \*(L"<em lang='fr'>\*(R") or the end of an element (an end-tag like \*(L"</em>\*(R". However, since more people claim to have been abducted by aliens than to have ever seen the \&\s-1SGML\s0 standard, and since both encounters typically involve a feeling of \&\*(L"missing time\*(R", it's not surprising that the terminology of the \s-1SGML\s0 standard is not closely followed. .RE .RE .RS 4 .RE .ie n .IP """_parent"" \*(-- (best accessed as ""$e\->parent"") the element that is $obj's parent, or undef if this element is the root of its tree." 4 .el .IP "\f(CW_parent\fR \*(-- (best accessed as \f(CW$e\->parent\fR) the element that is \f(CW$obj\fR's parent, or undef if this element is the root of its tree." 4 .IX Item "_parent (best accessed as $e->parent) the element that is $obj's parent, or undef if this element is the root of its tree." .PD 0 .ie n .IP """_content"" \*(-- (best accessed as ""$e\->content_list"") the list of nodes (i.e., elements or text segments) that are $e's children." 4 .el .IP "\f(CW_content\fR \*(-- (best accessed as \f(CW$e\->content_list\fR) the list of nodes (i.e., elements or text segments) that are \f(CW$e\fR's children." 4 .IX Item "_content (best accessed as $e->content_list) the list of nodes (i.e., elements or text segments) that are $e's children." .PD .PP Moreover, if an element object has any attributes in the \s-1SGML\s0 sense of the word, then those are readable as \f(CW\*(C`$e\->attr(\*(Aqname\*(Aq)\*(C'\fR \*(-- for example, with the object built from having parsed "<a \&\fBid='foo'\fR>bar</a>", \f(CW\*(C`$e\->attr(\*(Aqid\*(Aq)\*(C'\fR will return the string \*(L"foo\*(R". Moreover, \f(CW\*(C`$e\->tag\*(C'\fR on that object returns the string \*(L"a\*(R", \f(CW\*(C`$e\->content_list\*(C'\fR returns a list consisting of just the single scalar \*(L"bar\*(R", and \f(CW\*(C`$e\->parent\*(C'\fR returns the object that's this node's parent \*(-- which may be, for example, a \*(L"p\*(R" element. .PP And that's all that there is to it \*(-- you throw \s-1HTML\s0 source at TreeBuilder, and it returns a tree built of HTML::Element objects and some text strings. .PP However, what do you \fIdo\fR with a tree of objects? People code information into \s-1HTML\s0 trees not for the fun of arranging elements, but to represent the structure of specific text and images \*(-- some text is in this \*(L"li\*(R" element, some other text is in that heading, some images are in that other table cell that has those attributes, and so on. .PP Now, it may happen that you're rendering that whole \s-1HTML\s0 tree into some layout format. Or you could be trying to make some systematic change to the \s-1HTML\s0 tree before dumping it out as \s-1HTML\s0 source again. But, in my experience, by far the most common programming task that Perl programmers face with \s-1HTML\s0 is in trying to extract some piece of information from a larger document. Since that's so common (and also since it involves concepts that are basic to more complex tasks), that is what the rest of this article will be about. .SS "Scanning \s-1HTML\s0 trees" .IX Subsection "Scanning HTML trees" Suppose you have a thousand \s-1HTML\s0 documents, each of them a press release. They all start out: .PP .Vb 7 \& [...lots of leading images and junk...] \& <h1>ConGlomCo to Open New Corporate Office in Ougadougou</h1> \& BAKERSFIELD, CA, 2000\-04\-24 \-\- ConGlomCo\*(Aqs vice president in charge \& of world conquest, Rock Feldspar, announced today the opening of a \& new office in Ougadougou, the capital city of Burkino Faso, gateway \& to the bustling "Silicon Sahara" of Africa... \& [...etc...] .Ve .PP \&...and what you've got to do is, for each document, copy whatever text is in the \*(L"h1\*(R" element, so that you can, for example, make a table of contents of it. Now, there are three ways to do this: .IP "\(bu" 4 You can just use a regexp to scan the file for a text pattern. .Sp For many very simple tasks, this will do fine. Many \s-1HTML\s0 documents are, in practice, very consistently formatted as far as placement of linebreaks and whitespace, so you could just get away with scanning the file like so: .Sp .Vb 10 \& sub get_heading { \& my $filename = $_[0]; \& local *HTML; \& open(HTML, $filename) \& or die "Couldn\*(Aqt open $filename); \& my $heading; \& Line: \& while(<HTML>) { \& if( m{<h1>(.*?)</h1>}i ) { # match it! \& $heading = $1; \& last Line; \& } \& } \& close(HTML); \& warn "No heading in $filename?" \& unless defined $heading; \& return $heading; \& } .Ve .Sp This is quick and fast, but awfully fragile \*(-- if there's a newline in the middle of a heading's text, it won't match the above regexp, and you'll get an error. The regexp will also fail if the \*(L"h1\*(R" element's start-tag has any attributes. If you have to adapt your code to fit more kinds of start-tags, you'll end up basically reinventing part of HTML::Parser, at which point you should probably just stop, and use HTML::Parser itself: .IP "\(bu" 4 You can use HTML::Parser to scan the file for an \*(L"h1\*(R" start-tag token, then capture all the text tokens until the \*(L"h1\*(R" close-tag. This approach is extensively covered in the Ken MacFarlane's \s-1TPJ17\s0 article \&\*(L"Parsing \s-1HTML\s0 with HTML::Parser\*(R". (A variant of this approach is to use HTML::TokeParser, which presents a different and rather handier interface to the tokens that HTML::Parser picks out.) .Sp Using HTML::Parser is less fragile than our first approach, since it's not sensitive to the exact internal formatting of the start-tag (much less whether it's split across two lines). However, when you need more information about the context of the \*(L"h1\*(R" element, or if you're having to deal with any of the tricky bits of \s-1HTML,\s0 such as parsing of tables, you'll find out the flat list of tokens that HTML::Parser returns isn't immediately useful. To get something useful out of those tokens, you'll need to write code that knows some things about what elements take no content (as with \*(L"hr\*(R" elements), and that a \*(L"</p>\*(R" end-tags are omissible, so a \*(L"<p>\*(R" will end any currently open paragraph \*(-- and you're well on your way to pointlessly reinventing much of the code in HTML::TreeBuilder .RS 4 .Sp .RS 4 Footnote: And, as the person who last rewrote that module, I can attest that it wasn't terribly easy to get right! Never underestimate the perversity of people coding \s-1HTML.\s0 .RE .RE .RS 4 .Sp , at which point you should probably just stop, and use HTML::TreeBuilder itself: .RE .IP "\(bu" 4 You can use HTML::Treebuilder, and scan the tree of element objects that you get back. .PP The last approach, using HTML::TreeBuilder, is the diametric opposite of first approach: The first approach involves just elementary Perl and one regexp, whereas the TreeBuilder approach involves being at home with the concept of tree-shaped data structures and modules with object-oriented interfaces, as well as with the particular interfaces that HTML::TreeBuilder and HTML::Element provide. .PP However, what the TreeBuilder approach has going for it is that it's the most robust, because it involves dealing with \s-1HTML\s0 in its \*(L"native\*(R" format \*(-- it deals with the tree structure that \s-1HTML\s0 code represents, without any consideration of how the source is coded and with what tags omitted. .PP So, to extract the text from the \*(L"h1\*(R" elements of an \s-1HTML\s0 document: .PP .Vb 10 \& sub get_heading { \& my $tree = HTML::TreeBuilder\->new; \& $tree\->parse_file($_[0]); # ! \& my $heading; \& my $h1 = $tree\->look_down(\*(Aq_tag\*(Aq, \*(Aqh1\*(Aq); # ! \& if($h1) { \& $heading = $h1\->as_text; # ! \& } else { \& warn "No heading in $_[0]?"; \& } \& $tree\->delete; # clear memory! \& return $heading; \& } .Ve .PP This uses some unfamiliar methods that need explaining. The \&\f(CW\*(C`parse_file\*(C'\fR method that we've seen before, builds a tree based on source from the file given. The \f(CW\*(C`delete\*(C'\fR method is for marking a tree's contents as available for garbage collection, when you're done with the tree. The \f(CW\*(C`as_text\*(C'\fR method returns a string that contains all the text bits that are children (or otherwise descendants) of the given node \*(-- to get the text content of the \f(CW$h1\fR object, we could just say: .PP .Vb 1 \& $heading = join \*(Aq\*(Aq, $h1\->content_list; .Ve .PP but that will work only if we're sure that the \*(L"h1\*(R" element's children will be only text bits \*(-- if the document contained: .PP .Vb 1 \& <h1>Local Man Sees <cite>Blade</cite> Again</h1> .Ve .PP then the sub-tree would be: .PP .Vb 5 \& . h1 \& . "Local Man Sees " \& . cite \& . "Blade" \& . " Again\*(Aq .Ve .PP so \f(CW\*(C`join \*(Aq\*(Aq, $h1\->content_list\*(C'\fR will be something like: .PP .Vb 1 \& Local Man Sees HTML::Element=HASH(0x15424040) Again .Ve .PP whereas \f(CW\*(C`$h1\->as_text\*(C'\fR would yield: .PP .Vb 1 \& Local Man Sees Blade Again .Ve .PP and depending on what you're doing with the heading text, you might want the \f(CW\*(C`as_HTML\*(C'\fR method instead. It returns the (sub)tree represented as \s-1HTML\s0 source. \f(CW\*(C`$h1\->as_HTML\*(C'\fR would yield: .PP .Vb 1 \& <h1>Local Man Sees <cite>Blade</cite> Again</h1> .Ve .PP However, if you wanted the contents of \f(CW$h1\fR as \s-1HTML,\s0 but not the \&\f(CW$h1\fR itself, you could say: .PP .Vb 5 \& join \*(Aq\*(Aq, \& map( \& ref($_) ? $_\->as_HTML : $_, \& $h1\->content_list \& ) .Ve .PP This \f(CW\*(C`map\*(C'\fR iterates over the nodes in \f(CW$h1\fR's list of children; and for each node that's just a text bit (as \*(L"Local Man Sees \*(R" is), it just passes through that string value, and for each node that's an actual object (causing \f(CW\*(C`ref\*(C'\fR to be true), \f(CW\*(C`as_HTML\*(C'\fR will used instead of the string value of the object itself (which would be something quite useless, as most object values are). So that \f(CW\*(C`as_HTML\*(C'\fR for the \*(L"cite\*(R" element will be the string \*(L"<cite>Blade</cite>\*(R". And then, finally, \f(CW\*(C`join\*(C'\fR just puts into one string all the strings that the \&\f(CW\*(C`map\*(C'\fR returns. .PP Last but not least, the most important method in our \f(CW\*(C`get_heading\*(C'\fR sub is the \f(CW\*(C`look_down\*(C'\fR method. This method looks down at the subtree starting at the given object (\f(CW$h1\fR), looking for elements that meet criteria you provide. .PP The criteria are specified in the method's argument list. Each criterion can consist of two scalars, a key and a value, which express that you want elements that have that attribute (like \*(L"_tag\*(R", or \&\*(L"src\*(R") with the given value (\*(L"h1\*(R"); or the criterion can be a reference to a subroutine that, when called on the given element, returns true if that is a node you're looking for. If you specify several criteria, then that's taken to mean that you want all the elements that each satisfy \fIall\fR the criteria. (In other words, there's an \*(L"implicit \s-1AND\*(R".\s0) .PP And finally, there's a bit of an optimization \*(-- if you call the \&\f(CW\*(C`look_down\*(C'\fR method in a scalar context, you get just the \fIfirst\fR node (or undef if none) \*(-- and, in fact, once \f(CW\*(C`look_down\*(C'\fR finds that first matching element, it doesn't bother looking any further. .PP So the example: .PP .Vb 1 \& $h1 = $tree\->look_down(\*(Aq_tag\*(Aq, \*(Aqh1\*(Aq); .Ve .PP returns the first element at-or-under \f(CW$tree\fR whose \f(CW"_tag"\fR attribute has the value \f(CW"h1"\fR. .SS "Complex Criteria in Tree Scanning" .IX Subsection "Complex Criteria in Tree Scanning" Now, the above \f(CW\*(C`look_down\*(C'\fR code looks like a lot of bother, with barely more benefit than just grepping the file! But consider if your criteria were more complicated \*(-- suppose you found that some of the press releases that you were scanning had several \*(L"h1\*(R" elements, possibly before or after the one you actually want. For example: .PP .Vb 8 \& <h1><center>Visit Our Corporate Partner \& <br><a href="/dyna/clickthru" \& ><img src="/dyna/vend_ad"></a> \& </center></h1> \& <h1><center>ConGlomCo President Schreck to Visit Regional HQ \& <br><a href="/photos/Schreck_visit_large.jpg" \& ><img src="/photos/Schreck_visit.jpg"></a> \& </center></h1> .Ve .PP Here, you want to ignore the first \*(L"h1\*(R" element because it contains an ad, and you want the text from the second \*(L"h1\*(R". The problem is in formalizing the way you know that it's an ad. Since ad banners are always entreating you to \*(L"visit\*(R" the sponsoring site, you could exclude \&\*(L"h1\*(R" elements that contain the word \*(L"visit\*(R" under them: .PP .Vb 6 \& my $real_h1 = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& sub { \& $_[0]\->as_text !~ m/\ebvisit/i \& } \& ); .Ve .PP The first criterion looks for \*(L"h1\*(R" elements, and the second criterion limits those to only the ones whose text content doesn't match \&\f(CW\*(C`m/\ebvisit/\*(C'\fR. But unfortunately, that won't work for our example, since the second \*(L"h1\*(R" mentions "ConGlomCo President Schreck to \&\fIVisit\fR Regional \s-1HQ".\s0 .PP Instead you could try looking for the first \*(L"h1\*(R" element that doesn't contain an image: .PP .Vb 6 \& my $real_h1 = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& sub { \& not $_[0]\->look_down(\*(Aq_tag\*(Aq, \*(Aqimg\*(Aq) \& } \& ); .Ve .PP This criterion sub might seem a bit odd, since it calls \f(CW\*(C`look_down\*(C'\fR as part of a larger \f(CW\*(C`look_down\*(C'\fR operation, but that's fine. Note that when considered as a boolean value, a \f(CW\*(C`look_down\*(C'\fR in a scalar context value returns false (specifically, undef) if there's no matching element at or under the given element; and it returns the first matching element (which, being a reference and object, is always a true value), if any matches. So, here, .PP .Vb 3 \& sub { \& not $_[0]\->look_down(\*(Aq_tag\*(Aq, \*(Aqimg\*(Aq) \& } .Ve .PP means \*(L"return true only if this element has no 'img' element as descendants (and isn't an 'img' element itself).\*(R" .PP This correctly filters out the first \*(L"h1\*(R" that contains the ad, but it also incorrectly filters out the second \*(L"h1\*(R" that contains a non-advertisement photo besides the headline text you want. .PP There clearly are detectable differences between the first and second \&\*(L"h1\*(R" elements \*(-- the only second one contains the string \*(L"Schreck\*(R", and we could just test for that: .PP .Vb 6 \& my $real_h1 = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& sub { \& $_[0]\->as_text =~ m{Schreck} \& } \& ); .Ve .PP And that works fine for this one example, but unless all thousand of your press releases have \*(L"Schreck\*(R" in the headline, that's just not a general solution. However, if all the ads\-in\-\*(L"h1\*(R"s that you want to exclude involve a link whose \s-1URL\s0 involves \*(L"/dyna/\*(R", then you can use that: .PP .Vb 11 \& my $real_h1 = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& sub { \& my $link = $_[0]\->look_down(\*(Aq_tag\*(Aq,\*(Aqa\*(Aq); \& return 1 unless $link; \& # no link means it\*(Aqs fine \& return 0 if $link\->attr(\*(Aqhref\*(Aq) =~ m{/dyna/}; \& # a link to there is bad \& return 1; # otherwise okay \& } \& ); .Ve .PP Or you can look at it another way and say that you want the first \*(L"h1\*(R" element that either contains no images, or else whose image has a \*(L"src\*(R" attribute whose value contains \*(L"/photos/\*(R": .PP .Vb 11 \& my $real_h1 = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& sub { \& my $img = $_[0]\->look_down(\*(Aq_tag\*(Aq,\*(Aqimg\*(Aq); \& return 1 unless $img; \& # no image means it\*(Aqs fine \& return 1 if $img\->attr(\*(Aqsrc\*(Aq) =~ m{/photos/}; \& # good if a photo \& return 0; # otherwise bad \& } \& ); .Ve .PP Recall that this use of \f(CW\*(C`look_down\*(C'\fR in a scalar context means to return the first element at or under \f(CW$tree\fR that matches all the criteria. But if you notice that you can formulate criteria that'll match several possible \*(L"h1\*(R" elements, some of which may be bogus but the \fIlast\fR one of which is always the one you want, then you can use \f(CW\*(C`look_down\*(C'\fR in a list context, and just use the last element of that list: .PP .Vb 6 \& my @h1s = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqh1\*(Aq, \& ...maybe more criteria... \& ); \& die "What, no h1s here?" unless @h1s; \& my $real_h1 = $h1s[\-1]; # last or only .Ve .SS "A Case Study: Scanning Yahoo News's \s-1HTML\s0" .IX Subsection "A Case Study: Scanning Yahoo News's HTML" The above (somewhat contrived) case involves extracting data from a bunch of pre-existing \s-1HTML\s0 files. In that sort of situation, if your code works for all the files, then you know that the code \fIworks\fR \*(-- since the data it's meant to handle won't go changing or growing; and, typically, once you've used the program, you'll never need to use it again. .PP The other kind of situation faced in many data extraction tasks is where the program is used recurringly to handle new data \*(-- such as from ever-changing Web pages. As a real-world example of this, consider a program that you could use (suppose it's crontabbed) to extract headline-links from subsections of Yahoo News (\f(CW\*(C`http://dailynews.yahoo.com/\*(C'\fR). .PP Yahoo News has several subsections: .IP "http://dailynews.yahoo.com/h/tc/ for technology news" 4 .IX Item "http://dailynews.yahoo.com/h/tc/ for technology news" .PD 0 .IP "http://dailynews.yahoo.com/h/sc/ for science news" 4 .IX Item "http://dailynews.yahoo.com/h/sc/ for science news" .IP "http://dailynews.yahoo.com/h/hl/ for health news" 4 .IX Item "http://dailynews.yahoo.com/h/hl/ for health news" .IP "http://dailynews.yahoo.com/h/wl/ for world news" 4 .IX Item "http://dailynews.yahoo.com/h/wl/ for world news" .IP "http://dailynews.yahoo.com/h/en/ for entertainment news" 4 .IX Item "http://dailynews.yahoo.com/h/en/ for entertainment news" .PD .PP and others. All of them are built on the same basic \s-1HTML\s0 template \*(-- and a scarily complicated template it is, especially when you look at it with an eye toward making up rules that will select where the real headline-links are, while screening out all the links to other parts of Yahoo, other news services, etc. You will need to puzzle over the \s-1HTML\s0 source, and scrutinize the output of \&\f(CW\*(C`$tree\->dump\*(C'\fR on the parse tree of that \s-1HTML.\s0 .PP Sometimes the only way to pin down what you're after is by position in the tree. For example, headlines of interest may be in the third column of the second row of the second table element in a page: .PP .Vb 4 \& my $table = ( $tree\->look_down(\*(Aq_tag\*(Aq,\*(Aqtable\*(Aq) )[1]; \& my $row2 = ( $table\->look_down(\*(Aq_tag\*(Aq, \*(Aqtr\*(Aq ) )[1]; \& my $col3 = ( $row2\->look\-down(\*(Aq_tag\*(Aq, \*(Aqtd\*(Aq) )[2]; \& ...then do things with $col3... .Ve .PP Or they may be all the links in a \*(L"p\*(R" element that has at least three \&\*(L"br\*(R" elements as children: .PP .Vb 8 \& my $p = $tree\->look_down( \& \*(Aq_tag\*(Aq, \*(Aqp\*(Aq, \& sub { \& 2 < grep { ref($_) and $_\->tag eq \*(Aqbr\*(Aq } \& $_[0]\->content_list \& } \& ); \& @links = $p\->look_down(\*(Aq_tag\*(Aq, \*(Aqa\*(Aq); .Ve .PP But almost always, you can get away with looking for properties of the of the thing itself, rather than just looking for contexts. Now, if you're lucky, the document you're looking through has clear semantic tagging, such is as useful in \s-1CSS\s0 \*(-- note the class=\*(L"headlinelink\*(R" bit here: .PP .Vb 2 \& <a href="...long_news_url..." class="headlinelink">Elvis \& seen in tortilla</a> .Ve .PP If you find anything like that, you could leap right in and select links with: .PP .Vb 1 \& @links = $tree\->look_down(\*(Aqclass\*(Aq,\*(Aqheadlinelink\*(Aq); .Ve .PP Regrettably, your chances of seeing any sort of semantic markup principles really being followed with actual \s-1HTML\s0 are pretty thin. .Sp .RS 4 Footnote: In fact, your chances of finding a page that is simply free of \s-1HTML\s0 errors are even thinner. And surprisingly, sites like Amazon or Yahoo are typically worse as far as quality of code than personal sites whose entire production cycle involves simply being saved and uploaded from Netscape Composer. .RE .PP The code may be sort of \*(L"accidentally semantic\*(R", however \*(-- for example, in a set of pages I was scanning recently, I found that looking for \&\*(L"td\*(R" elements with a \*(L"width\*(R" attribute value of \*(L"375\*(R" got me exactly what I wanted. No-one designing that page ever conceived of \&\*(L"width=375\*(R" as \fImeaning\fR \*(L"this is a headline\*(R", but if you impute it to mean that, it works. .PP An approach like this happens to work for the Yahoo News code, because the headline-links are distinguished by the fact that they (and they alone) contain a \*(L"b\*(R" element: .PP .Vb 1 \& <a href="...long_news_url..."><b>Elvis seen in tortilla</b></a> .Ve .PP or, diagrammed as a part of the parse tree: .PP .Vb 3 \& . a [href="...long_news_url..."] \& . b \& . "Elvis seen in tortilla" .Ve .PP A rule that matches these can be formalized as \*(L"look for any 'a' element that has only one daughter node, which must be a 'b' element\*(R". And this is what it looks like when cooked up as a \f(CW\*(C`look_down\*(C'\fR expression and prefaced with a bit of code that retrieves the text of the given Yahoo News page and feeds it to TreeBuilder: .PP .Vb 5 \& use strict; \& use HTML::TreeBuilder 2.97; \& use LWP::UserAgent; \& sub get_headlines { \& my $url = $_[0] || die "What URL?"; \& \& my $response = LWP::UserAgent\->new\->request( \& HTTP::Request\->new( GET => $url ) \& ); \& unless($response\->is_success) { \& warn "Couldn\*(Aqt get $url: ", $response\->status_line, "\en"; \& return; \& } \& \& my $tree = HTML::TreeBuilder\->new(); \& $tree\->parse($response\->content); \& $tree\->eof; \& \& my @out; \& foreach my $link ( \& $tree\->look_down( # ! \& \*(Aq_tag\*(Aq, \*(Aqa\*(Aq, \& sub { \& return unless $_[0]\->attr(\*(Aqhref\*(Aq); \& my @c = $_[0]\->content_list; \& @c == 1 and ref $c[0] and $c[0]\->tag eq \*(Aqb\*(Aq; \& } \& ) \& ) { \& push @out, [ $link\->attr(\*(Aqhref\*(Aq), $link\->as_text ]; \& } \& \& warn "Odd, fewer than 6 stories in $url!" if @out < 6; \& $tree\->delete; \& return @out; \& } .Ve .PP \&...and add a bit of code to actually call that routine and display the results... .PP .Vb 9 \& foreach my $section (qw[tc sc hl wl en]) { \& my @links = get_headlines( \& "http://dailynews.yahoo.com/h/$section/" \& ); \& print \& $section, ": ", scalar(@links), " stories\en", \& map((" ", $_\->[0], " : ", $_\->[1], "\en"), @links), \& "\en"; \& } .Ve .PP And we've got our own headline-extractor service! This in and of itself isn't no amazingly useful (since if you want to see the headlines, you \fIcan\fR just look at the Yahoo News pages), but it could easily be the basis for quite useful features like filtering the headlines for matching certain keywords of interest to you. .PP Now, one of these days, Yahoo News will decide to change its \s-1HTML\s0 template. When this happens, this will appear to the above program as there being no links that meet the given criteria; or, less likely, dozens of erroneous links will meet the criteria. In either case, the criteria will have to be changed for the new template; they may just need adjustment, or you may need to scrap them and start over. .SS "\fIRegardez, duvet!\fP" .IX Subsection "Regardez, duvet!" It's often quite a challenge to write criteria to match the desired parts of an \s-1HTML\s0 parse tree. Very often you \fIcan\fR pull it off with a simple \f(CW\*(C`$tree\->look_down(\*(Aq_tag\*(Aq, \*(Aqh1\*(Aq)\*(C'\fR, but sometimes you do have to keep adding and refining criteria, until you might end up with complex filters like what I've shown in this article. The benefit to learning how to deal with \s-1HTML\s0 parse trees is that one main search tool, the \f(CW\*(C`look_down\*(C'\fR method, can do most of the work, making simple things easy, while still making hard things possible. .PP \&\fB[end body of article]\fR .SS "[Author Credit]" .IX Subsection "[Author Credit]" Sean M. Burke (\f(CW\*(C`sburke@cpan.org\*(C'\fR) is the current maintainer of \&\f(CW\*(C`HTML::TreeBuilder\*(C'\fR and \f(CW\*(C`HTML::Element\*(C'\fR, both originally by Gisle Aas. .PP Sean adds: \*(L"I'd like to thank the folks who listened to me ramble incessantly about HTML::TreeBuilder and HTML::Element at this year's Yet Another Perl Conference and O'Reilly Open Source Software Convention.\*(R" .SH "BACK" .IX Header "BACK" Return to the HTML::Tree docs.
Save
cmd:
run