GpNc@sdZddlZddlZddlZddlZddlZddlZddlZyddl m Z Wn!e k rddl m Z nXddl mZddlmZddlZddlZejjdZdZdZd ejjfd YZddlZddlZddlZddlZead ej fd YZ!d ej"fdYZ#eddZ$e%dkrddl&Z&ddlZeaea'ea(de&j)fdYZ*e&j+ndS(s,Crash database implementation for Launchpad.iN(tStringIO(t HTTPError(t Launchpads%~/.cache/apport/launchpad.credentialsccs{xt|D]l}y|jj}Wn!tk rCtjdqnX|j}|jdsk|jdr|VqqWdS(Ns"Broken attachment on bug, ignorings.txts.gz(tdatatopenRtapportterrortfilenametendswith(t attachmentst attachmenttftname((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytfilter_filenames    cCstd|DS(Ncss-|]#}t|jjdjVqdS(t/N(tintt self_linktsplittpop(t.0ti((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pys )s(tset(ttasks((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytid_set'st CrashDatabasecBseZdZdZedZdZedZddZ dZ dZ dZ e ddd Zd d Zd Zd ZdZdZdZdZdZdZdZdZdZdZdZddZdZdZRS(s5Launchpad implementation of crash database interface.cCs9tjdr%tjd|dDownload the problem report from given ID and return a Report.s(ProblemType:.*)$s^--- \r?$[\r\n]*(.*)s8bug description must contain standard apport format dataisUTF-8s RVs s s sUname:itDateRQs apport-bugtBugs apport-crashtCrashsapport-kernelcrasht KernelCrashsapport-packageR`s(cannot determine ProblemType from tags: RRR|t OriginalTitlets.txts.gztfileobjs Not a gzipsUnknown attachment type: ($RtReportRGtbugsRKtsearcht descriptiontStMR&tgrouptencodetreplaceRtloadRt date_createdtctimetAttributeErrorttagst ValueErrorRAtjoinRR R R R:tsplitextRtreadtgziptGzipFiletIOErrorRpR?( R0tidRstbtmRtpart1tpart2R tkeytextRE((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytdownloadsd %0  -             cCs |jj|}|r5t|jt|}nd}tj} |j| d|| j| j dt j | } | j } | j } | jst| j } | j st| jdkst|sJ|j} | jd|jdr$| |dj7} n| |_|j|jj|}n|r|jd| jdtjdd |_|jn"|jd | jdtd |xZ| D]R} |jd |pd d| jddd| jdtd| jdtqWdS(sqUpdate the given report ID with all data from report. This creates a text comment with the "short" data (see ProblemReport.write_mime()), and creates attachments for all the bulk/binary data. If change_description is True, and the crash db implementation supports it, the short data will be put into the description instead (like in a new bug). comment will be added to the "short" data. If attachment_comment is given, it will be added to the attachment uploads. If key_filter is a list or set, then only those keys will be added. Rhis text/plainsapport-collectedRRs --- tdecodesUTF-8RR9tsubjecttcommentRRt content_typeRRtis_patchN(RGRRtkeysR,RlRmRnRoRptemailtmessage_from_filetwalktnextt is_multipartR&tget_content_typeRtappendRkRtlp_saveRt get_payloadtTrueRt newMessaget addAttachmentt get_filenametFalse(R0RRsRtchange_descriptiontattachment_commentt key_filtertbugRhRxRFtmsg_itertparttx((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytupdateBsD          ,   RcCsOtjjj|||||jj|}|jdrxc|jD]U}|jj j drE|j j d|d|_|j |jj|}PqEqEWn|jr;xE|jD]:}|jdkry|jWqtk rqXqqWy/|j|jj}d|_|j Wq;tk r7q;Xn|j||dS(sUpdate the given report ID for retracing results. This updates Stacktrace, ThreadStacktrace, StacktraceTop, and StacktraceSource. You can also supply an additional comment. R}s #distributionR s CoreDump.gztMediumN(RR$Rt update_tracesRGRRkt bug_tasksttargettresource_type_linkRRPtgetSourcePackageRthas_useful_stacktraceR Rt removeFromBugRRNRt importanceRHt_subscribe_triaging_team(R0RRsRRttaskRv((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRs.       cCsH|jj|}tjd|j}|r8|jdStddS(sNGet 'DistroRelease: ' from the given report ID and return it.s"DistroRelease: ([-a-zA-Z0-9.+/ ]+)is)URL does not contain DistroRelease: fieldN(RGRRKRRRR(R0RRR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytget_distro_releases  cCstjd|j}|jj|}g}x]|jD]R}|j|jj}|s]q6n|j dkrrq6n|j |j dq6W|S(s5Return list of affected source packages for given ID.s5/%s/(?:(?P[^/]+)/)?\+source/(?P[^/]+)$tInvalids Won't Fixs Fix Releasedtsource(Rs Won't Fixs Fix Released( RKtcompileRRGRRRRRtstatusRR(R0Rt bug_target_reRtresultRRL((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytget_affected_packagess cCs)|jj|}|jj|jjjkS(s3Check whether the user is the reporter of given ID.(RGRtownerR tme(R0RR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt is_reporterscCsz|jj|}|jrtS|jj|jjjkr<tS|jjj}x(|j j D]}|d|krXtSqXWtS(sBCheck whether the user is eligible to update a report. A user should add additional information to an existing ID if (s)he is the reporter or subscribed, the bug is open, not a duplicate, etc. The exact policy and checks should be done according to the particular implementation. t person_link( RGRt duplicate_ofRRR RRRt subscriptionstentries(R0RRRtsub((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt can_updates cCscy&|jjd|j}t|SWn6tk r^}tjdt|tj dnXdS(s}Return an ID set of all crashes which have not been retraced yet and which happened on the current host architecture.Rs"connecting to Launchpad failed: %sicN( RPt searchTasksR)RR?RRRARBRC(R0RRE((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytget_unretraceds cCs`y#|jjdd}t|SWn6tk r[}tjdt|tjdnXdS(s#Return an ID set of all crashes which have not been checked for being a duplicate. This is mainly useful for crashes of scripting languages such as Python, since they do not need to be retraced. It should not return bugs that are covered by get_unretraced().Rsneed-duplicate-checks"connecting to Launchpad failed: %sicN( RPRRR?RRRARBRC(R0RRE((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytget_dup_uncheckeds cCs|jjdd}t|S(sWReturn an ID set of all crashes which are not yet fixed. The list must not contain bugs which were rejected or duplicate. This function should make sure that the returned list is correct. If there are any errors with connecting to the crash database, it should raise an exception (preferably IOError).Rs apport-crash(RPRR(R0R((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt get_unfixeds cCs5|jjjdtd|d|jj}|djS(sReturn the version of given source package in the latest release of given distribution. If 'distro' is None, we will look for a launchpad project . t exact_matcht source_namet distro_seriesi(RPt main_archivetgetPublishedSourcesRtcurrent_seriestsource_package_version(R0tpackagetsources((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt_get_source_version s c syjj|}Wntk r(dSX|jr6dSt|j}jr^djjtfd|}|stfd|}|rdSnt |dkrt j dj|dS|r|j }yj |jjdSWq[tk rdSXqtfd |}|rtfd |}|s[dSqn2td |}|rzdStd |rdSd S(sReturn the package version that fixes a given crash. Return None if the crash is not yet fixed, or an empty string if the crash is fixed, but it cannot be determined by which version. Return 'invalid' if the crash report got invalidated, such as closed a duplicate or rejected. This function should make sure that the returned result is correct. If there are any errors with connecting to the crash database, it should raise an exception (preferably IOError). tinvalids(%s)cs"|jdko!|jjkS(Ns Fix Released(Rtbug_target_display_nameRJ(R(tdistro_identifier(sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt5scs+|jdko*|jjjjkS(Ns Fix Released(RRIRJR(R(R0(sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR9sRisVThere is more than one task fixed in %s %s, using first one to determine fixed versionics"|jdko!|jjkS(NRs Won't Fix(sInvalids Won't Fix(RRRJ(R(R(sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRLscs"|jdko!|jjkS(NRs Won't Fix(sInvalids Won't Fix(RRRJ(R(R(sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyROscSs |jdkS(Ns Fix Released(R(R((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRTscSs |jdkS(NR(R(R((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRZsN(RGRtKeyErrorRtlistRRRJtfiltertlenRtwarningRRRRt IndexErrorR,( R0RRRt fixed_taskst fixed_distroRt invalid_taskstnon_invalid_tasks((R0RsA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytget_fixed_versionsN            cCs(|jj|j}|r |jSdSdS(scReturn master ID for a duplicate bug. If the bug is not a duplicate, return None. N(RGRRRR,(R0RR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR_sc Cs7|jj|}|r||ks5tdt||jj|}|jr|j}|j|krtjd||dSnxE|jD]:}|j dkry|j Wqt k rqXqqW|jj|}|j d d |dd|jj|}|j rt|_ n|js,||_nt|jdkrd|jkr|jd|jkr|jjdd|jkr|j|jdg|_|jnd|jkr|jjdd|jkr|jj|jd}|jd|qqn|jrd|_n|jr3|jndS(stMark a crash id as duplicate of given master ID. If master is None, id gets un-duplicated. s+cannot mark bug %s as a duplicate of itselfsNBug %i was manually marked as a dupe of newer bug %i, not closing as duplicateNs CoreDump.gzsStacktrace.txtsThreadStacktrace.txtsDependencies.txts ProcMaps.txtsProcStatus.txts Registers.txtsDisassembly.txtR9sThank you for taking the time to report this crash and helping to make Ubuntu better. This particular crash has already been reported and is a duplicate of bug #%i, so is being marked as such. Please look at the other bug report to see if there is any missing information that you can provide, or to see if there is a workaround for the bug. Additionally, any further discussion regarding the bug should occur in the other report. Please continue to report any other bugs you may find.RsThis bug is a duplicatei tescalation_tagt escalated_tags invalid tescalation_subscriptiontperson(s CoreDump.gzsStacktrace.txtsThreadStacktrace.txtsDependencies.txts ProcMaps.txtsProcStatus.txts Registers.txtsDisassembly.txt(RGRR&RARRRRR RRRRtprivateRRt duplicatesR*RR"Rtpeoplet subscribeR,t_dirty_attributes(R0Rt master_idRtmasterRvtp((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytclose_duplicatejsR                 cCs[|jj|}|jdd|dd|jj|}|jdg|_|jdS(spMark a crash id as reintroducing an earlier crash which is already marked as fixed (having ID 'master').R9sThis crash has the same stack trace characteristics as bug #%i. However, the latter was already fixed in an earlier package version than the one in this report. This might be a regression or because the problem is in a dependent package.RsPossible regression detectedsregression-retracerN(RGRRRR(R0RRR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytmark_regressions  cCsn|jj|}|j|jkrj|j}|j|j||_y|jWqjtk rfqjXndS(sMark crash id as retraced.N(RGRR)RtremoveRR(R0RRR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt mark_retraceds   cCs|jj|}|ry|j|jj}Wntk rR|jd}nXd|_|j|jd|ddxw|j D]:}|j dkry|j Wqt k rqXqqWn/d|j kr|j dg|_ |jndS( s%Mark crash id as 'failed to retrace'.iRR9Rs Crash report cannot be processeds CoreDump.gzsapport-failed-retraceN(RGRRNRRRHRRRR RRRR(R0Rt invalid_msgRRRv((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytmark_retrace_faileds&    cCs|jj|}|jdrxc|jD]U}|jjjdr)|jjd|d|_|j |jj|}Pq)q)Wnd|j kr|j }|j d||_ |j n|j ||dS(s/Mark crash id as checked for being a duplicate.R}s #distributionR sneed-duplicate-checkN( RGRRkRRRRRPRRRR R(R0RRsRRR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt_mark_dup_checkeds       cCsNd|kr*|djddkr*dSd|jj}|jd|dS(s-Subscribe the right triaging team to the bug.RWitUbuntuNs%s~ubuntu-crashes-universeR(RRGt _root_uriR(R0RRsR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRs&N( t__name__t __module__t__doc__R%tpropertyRGRNRPR,RzRrRRRRRRRRRRRRRRRR R R RRR(((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR,s8 1  7  QH "      F A   tHTTPSProgressConnectioncBseZdZdZRS(sWImplement a HTTPSConnection with an optional callback function for upload progress.cCststjj||dSd}t|}d}x||krt||tj}tjj|||||!||7}tj}||dkr|d9}q8||dkr8|d:}q8q8WdS(Niig?i(t_https_upload_callbackthttplibtHTTPSConnectiontsendRttime(R0Rtsentttotalt chunksizett1tt2((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRs       (RRRR(((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRstHTTPSProgressHandlercBseZdZRS(cCs|jt|S(N(tdo_openR(R0treq((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt https_open.s(RRR%(((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR",ss launchpad.netcCsdd}|atjttj}d|}|j|idd6|d6}|jj d}|S(s Upload blob (file-like object) to Launchpad. progress_callback can be set to a function(sent, total) which is regularly called with the number of bytes already sent and total number of bytes to send. It is called every 0.5 to 2 seconds (dynamically adapted to upload bandwidth). Return None on error, or the ticket number on success. By default this uses the production Launchpad hostname. Set hostname to 'launchpad.dev' or 'staging.launchpad.net' to use another instance for testing. shttps://%s/+storeblobt1t FORM_SUBMITs field.blobsX-Launchpad-Blob-TokenN( R,Rturllib2t build_openerR"tmultipartpost_handlertMultipartPostHandlerRtinfoR"(tblobRtRjRytopenerturlR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRq1s  t__main__t_TcBs[eZdZdZdZdZdZedZdZ dZ dZ dZ d Z d Zd Zd Zd ZdZdZdZdZdZdZdZdZedZedZdZd#dZdZ dZ!dZ"dZ#dZ$dZ%d Z&d!Z'd"Z(RS($t coreutilscCsts|jant|_tj|_|jj|jjd|jd<|j|_|j d|jj |_ |jj |_ dS(NR2R}slangpack-o-matic( R$t _get_instanceRRt ref_reportt add_os_infot add_user_infot_file_uncommon_description_bugtuncommon_description_bugt_create_projectRt known_test_idtknown_test_id2(R0((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pytsetUpas     c Cs]|jjj|}|sY|jjjjd|dd|d|d|dd|dndS(s8Create a project using launchpadlib to be used by tests.Rt display_nameR tsummaryRN(R$RGtprojectst new_project(R0R R((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR9vs  cCs1d}|jjjjddd|d|jjS(sFile a bug report with an uncommon description. Example taken from real LP bug 269539. It contains only ProblemType/Architecture/DistroRelease in the description, and has free-form description text after the Apport data. sbproblem ProblemType: Package Architecture: amd64 DistroRelease: Ubuntu 8.10 more text and more Rumixed description bugRR(R$RGRt createBugRP(R0tdesc((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR7s cCs |jjS(s1Get the Launchpad hostname for the given crashdb.(R$Rr(R0((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRjscCstjjj}|j|j|j|j|j|j |j dd|d|dD]2}|jjj|}|ro| jd|qoqoWxJ|dD]>}|jjjd|jj|f}| jd|qWt| jS(sFile a bug report.R|ttokenRiRtextra_descriptionRRt initial_tagsRRtcommentsR9s http://%sR t file_alias_idRRRRt subscribersRthwdb_submission_keyss(https://api.%s/beta/+hwdb/+submission/%st submission(R"R~R$RGttemporary_blobstfetchRthasBeenProcessedRtsleeptgetProcessedDataRRARRRturlopentbasejoinRARRRRRrtlinkHWSubmissionRR(R0RNRsRRt bug_titlet blob_infoR-tprocessed_blobRt librarian_urlR RRRt subscriberRtsubmission_keyR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRLTsF       $   cCsR|jjj|}|jj|jkrN|j|jjg|_|jndS(s$Mark a report ID as needing retrace.N(R$RGRR)RR(R0RR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyR}scCsF|jjj|}d|jkrB|jdg|_|jndS(s,Mark a report ID as needing duplicate check.sneed-duplicate-checkN(R$RGRRR(R0RR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyt_mark_needs_dupcheckscCs[|jjj|}t|j}t|dks:t|d}d|_|jdS(sClose a report ID as "fixed".iis Fix ReleasedN( R$RGRRRRR&RR(R0RRRRM((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRs   cCs[|jjj|}t|j}t|dks:t|d}d|_|jdS(sReopen a report ID as "new".iitNewN( R$RGRRRRR&RR(R0RRRRM((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRs   cCs-|jjj|}|jd|jkdS(s.Verify that report ID is marked as regression.sregression-retracerN(R$RGRRJR(R0RR((sA/usr/lib/python2.7/dist-packages/apport/crashdb_impl/launchpad.pyRzscCs tjjdpd}ttjjddidd6|d6}|j|jdtjd}d |d s< H     0