{"id":13775,"date":"2023-04-18T12:49:47","date_gmt":"2023-04-18T12:49:47","guid":{"rendered":"https:\/\/prizmlaw.com\/site\/?p=13775"},"modified":"2025-04-18T17:51:52","modified_gmt":"2025-04-18T17:51:52","slug":"using-lang-models-2","status":"publish","type":"post","link":"https:\/\/prizmlaw.com\/site\/2023\/04\/18\/using-lang-models-2\/","title":{"rendered":"Using Language Models to Understand Complex Documents"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"13775\" class=\"elementor elementor-13775\">\n\t\t\t\t<div class=\"elementor-element elementor-element-40a6c62 e-flex e-con-boxed e-con e-parent\" data-id=\"40a6c62\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-a7896ce elementor-widget elementor-widget-heading\" data-id=\"a7896ce\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Using Language Models to Understand Complex Documents<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-01352f4 elementor-widget elementor-widget-heading\" data-id=\"01352f4\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h5 class=\"elementor-heading-title elementor-size-default\">(Part 2: Results)<\/h5>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b4a64d9 elementor-widget elementor-widget-pix-img\" data-id=\"b4a64d9\" data-element_type=\"widget\" data-widget_type=\"pix-img.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<div class=\"pix-img-element d-inline-block \" ><div class=\"pix-img-el    text-left d-inline-block  w-100 rounded-lg\"  ><img fetchpriority=\"high\" decoding=\"async\" class=\"card-img2 pix-img-elem rounded-lg  h-1002\" style=\"height:auto;\" width=\"1010\" height=\"444\" srcset=\"https:\/\/prizmlaw.com\/site\/wp-content\/uploads\/2025\/04\/robotReading.jpg 1010w, https:\/\/prizmlaw.com\/site\/wp-content\/uploads\/2025\/04\/robotReading-300x132.jpg 300w, https:\/\/prizmlaw.com\/site\/wp-content\/uploads\/2025\/04\/robotReading-768x338.jpg 768w\" sizes=\"(max-width: 1010px) 100vw, 1010px\" src=\"https:\/\/prizmlaw.com\/site\/wp-content\/uploads\/2025\/04\/robotReading.jpg\" alt=\"Image link\" \/><\/div><\/div>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e90ea11 elementor-widget elementor-widget-text-editor\" data-id=\"e90ea11\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>In the <a href=\"https:\/\/prizmlaw.com\/site\/2023\/04\/18\/using-lang-models-1\/\" data-type=\"post\" data-id=\"2049\">previous article<\/a> I described the architecture of a system that enables a user to ask questions of a long, complex document. As I generate complex legal documents for clients, I\u2019m interested in the idea of allowing my clients to understand those documents and get answers about the implications of those documents without necessarily booking time with me. To do this, I\u2019m taking advantage of some of the large language AI models (LLMs) out there. In this example, I\u2019m using one of OpenAI\u2019s GPT-3 models. On top of that model, I\u2019m layering some programming logic in Python. I\u2019m also converting both the user\u2019s query and the document content to <a href=\"https:\/\/openai.com\/blog\/introducing-text-and-code-embeddings\/\" target=\"_blank\" rel=\"noreferrer noopener\" data-type=\"URL\" data-id=\"https:\/\/openai.com\/blog\/introducing-text-and-code-embeddings\/\">vector embeddings<\/a> that power a more precise content search within the document.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-60eedc1 elementor-widget elementor-widget-text-editor\" data-id=\"60eedc1\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Now I\u2019d like to take that system for a test drive. For this demonstration, I\u2019m using the 128-page document \u201c<a href=\"https:\/\/www.medicare.gov\/publications\/10050-Medicare-and-You.pdf\" target=\"_blank\" rel=\"noreferrer noopener\" data-type=\"URL\" data-id=\"https:\/\/www.medicare.gov\/publications\/10050-Medicare-and-You.pdf\">Medicare &amp; You 2023<\/a>\u201d as the source document. The question I\u2019ll run through the system: \u201cIs long-term care covered?\u201d I want to compare the answer I arrive at as a human to the answer(s) provided by this system.\u00a0You can see details of all the results <a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1Sczwwu6eVJzMj2HUtnC4YsZJ-HYrq2EBPOa9SUoUY5g\/edit?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\" data-type=\"URL\" data-id=\"https:\/\/docs.google.com\/spreadsheets\/d\/1Sczwwu6eVJzMj2HUtnC4YsZJ-HYrq2EBPOa9SUoUY5g\/edit?usp=sharing\">in a spreadsheet here<\/a>.<\/p><p>Of course while the question seems straight-forward, when the user asks this question, there may be any number of implicit questions that they actually want answers to which include:<\/p><ul class=\"wp-block-list\"><li>Do I have long-term coverage?<\/li><li>How do I get long-term coverage if I have Medicare?<\/li><li>Can I afford to live in a nursing home?<\/li><\/ul><p>The user may not know that \u201clong-term care\u201d is actually a term of art and may not be using it correctly in their question. A more sophisticated system would account for these implicit questions in generating the answer. For the sake of this exercise however, I\u2019m going to take the question at face value.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-f69d241 e-flex e-con-boxed e-con e-parent\" data-id=\"f69d241\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-c741554 elementor-widget elementor-widget-heading\" data-id=\"c741554\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Human vs. A.I. Answers<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-fd30358 elementor-widget elementor-widget-text-editor\" data-id=\"fd30358\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>After reviewing the Medicare document, after about <strong>15-minutes<\/strong>, this is the answer I came up with:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d3e7220 elementor-widget elementor-widget-pix-badge\" data-id=\"d3e7220\" data-element_type=\"widget\" data-widget_type=\"pix-badge.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<span class=\"pix-badge-element h6 d-inline-flex mr-1 \"  ><span class=\"badge font-weight-bold bg-primary-light  \" style=\" \"><span class=\"text-primary\" style=\"\">Is long-term care covered?<\/span><\/span><\/span>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-d2770d7 elementor-widget elementor-widget-pix-testimonial\" data-id=\"d2770d7\" data-element_type=\"widget\" data-widget_type=\"pix-testimonial.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<div class=\"pix-content-box card        body-default rounded-lg bg-light-opacity-5 w-100  \"   ><div class=\"\" style=\"z-index:30;position:relative;\"><div class=\"card-body rounded-lg bg-light-opacity-5\" ><p class=\"card-text  text-body-default \" >\u201cIt depends on what you mean by \u201clong-term care.\u201d As a general rule, Medicare does not pay for non-medical long-term care. However, if you have a medical event that requires a 3-day minimum inpatient hospital stay (with some exceptions), then Medicare may cover skilled nursing care. Generally, this is limited to 100 days of care within each benefit period.\u201d<\/p><h6 class=\"card-title mb-1 font-weight-bold text-dark-opacity-4\" >Julian's Answer<\/h6><\/div><\/div><\/div>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-e91ad83 elementor-widget elementor-widget-text-editor\" data-id=\"e91ad83\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>And this is the answer generated by my system in about <strong>10 seconds<\/strong>:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-dd97cdd elementor-widget elementor-widget-pix-testimonial\" data-id=\"dd97cdd\" data-element_type=\"widget\" data-widget_type=\"pix-testimonial.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<div class=\"pix-content-box card        body-default rounded-lg bg-light-opacity-5 w-100  \"   ><div class=\"\" style=\"z-index:30;position:relative;\"><div class=\"card-body rounded-lg bg-light-opacity-5\" ><p class=\"card-text  text-body-default \" >\u201cOriginal Medicare is a type of Medicare health coverage. With Original Medicare, you generally have to pay a portion of the cost for each service that is covered. There is no limit to what you can pay out of pocket in a year, unless you have other coverage, like Medigap, Medicaid, or employee or union coverage. Original Medicare does not cover most drugs, with a few exceptions. You can add Medicare drug coverage by joining a separate Medicare drug plan. In most cases, you can go to any Medicare-enrolled doctor or other health care provider that accepts Medicare patients anywhere in the United States. Long-term care is not covered by Medicare. This includes care in a skilled nursing facility, which is only covered if the patient has been hospitalized for at least three days. If the patient is in a Medicare Advantage Plan, they may not need to be hospitalized for three days.\u201d<\/p><h6 class=\"card-title mb-1 font-weight-bold text-dark-opacity-4\" >Python+LLM RAG Answer<\/h6><\/div><\/div><\/div>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-585f3c3 elementor-widget elementor-widget-text-editor\" data-id=\"585f3c3\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>I find my answer a bit more concise and on-point than the AI answer. That said, the system does eventually answer the question. However, the final answer isn\u2019t as interesting as the thought processes and source texts used to get to the answer.<\/p><p>To formulate my answer, I pulled information from the following parts of the document. All come from \u201cSection 2: Finding out if Medicare covers your test, item, or service\u201d and are listed in order of importance to answering the question:<\/p><ol class=\"wp-block-list\"><li>\u201cWhat\u2019s Not Covered by Part A and Part B\u201d (Page 55): States that long-term care is not covered.\u00a0<\/li><li>\u201cPaying for Long-term Care\u201d (Page 56): Definition of \u201clong-term care\u201d and scope of Medicare coverage.<\/li><li>\u201cWhat Service Does Medicare Cover?\u201d (Page 25): States thatin-patient care in skilled nursing facility is covered, but long-term care is not.<\/li><li>\u201cSkilled Nursing Facility Care\u201d (Page 28): Describes the 3-day minimum stay requirement and cost structure.<\/li><\/ol><p>While I probably should have read the table of contents carefully, identified potentially relevant sections, and read each section in context; I took the quick-and-dirty approach of searching the document for \u201clong-term\u201d (Ctrl-F) and jumped right to the sections that appeared in the results. \ud83d\ude05 I took what I thought was the most human approach to the task.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-d79ee31 e-flex e-con-boxed e-con e-parent\" data-id=\"d79ee31\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-0977276 elementor-widget elementor-widget-heading\" data-id=\"0977276\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">A.I. Answers and Sources<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-72fb26e elementor-widget elementor-widget-text-editor\" data-id=\"72fb26e\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>In contrast, let\u2019s look at the material the system used to answer the question. Here are the sections of information (chunks as described in the previous article) used as a basis for the AI response. This is, in a sense, the system\u2019s thought process. As outlined in <a href=\"https:\/\/lexploration.co\/creating-a-python-based-document-qa-app-using-gpt-3\/\" data-type=\"post\" data-id=\"2049\">my earlier article<\/a>, I use a vector-based search to get the top 3 chunks of relevant text and then ask GPT-3 to generate a distinct answer based just on that chunk.\u00a0<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-2650a87 elementor-widget elementor-widget-pix-badge\" data-id=\"2650a87\" data-element_type=\"widget\" data-widget_type=\"pix-badge.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<span class=\"pix-badge-element h6 d-inline-flex mr-1 \"  ><span class=\"badge font-weight-bold bg-secondary  \" style=\" \"><span class=\"text-white\" style=\"\">Retrieved Document Chunks for A.I. Answers<\/span><\/span><\/span>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b7b6acc elementor-widget elementor-widget-pix-accordion\" data-id=\"b7b6acc\" data-element_type=\"widget\" data-widget_type=\"pix-accordion.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<div class=\"accordion w-100 accordion-card bg-white2 rounded-lg2\" id=\"accordion-b7b6acc\"><div class=\"card\">\n               <div class=\"card-header pix-mb-10 shadow-sm rounded-lg bg-white\" id=\"headingpix-tab-b7b6acc-d04f7ef\" >\n                   <button class=\"btn btn-link d-flex text-left\" type=\"button\" data-toggle=\"collapse\" data-target=\"#collapsepix-tab-b7b6acc-d04f7ef\" aria-expanded=\"true\" aria-controls=\"collapsepix-tab-b7b6acc-d04f7ef\"><span class=\"d-inline-flex align-self-center text-primary svg-202 text-20 pix-mr-10\"><i class=\" \"><\/i><\/span><span class=\"d-inline-flex font-weight-bold text-heading-default\" >#1 \u201cWhat\u2019s Not Covered by Part A & Part B\u201d \/ \u201cPaying for Long Term Care\u201d (Pages 55-56)<\/span><\/button>\n               <\/div>\n\n               <div id=\"collapsepix-tab-b7b6acc-d04f7ef\" class=\"collapse \" aria-labelledby=\"headingpix-tab-b7b6acc-d04f7ef\">\n                 <div class=\"card-body\"><p><strong>Sub-Answer #1<\/strong>: \u201cOriginal Medicare is one of your Medicare health coverage choices. Youll have Original Medicare unless you choose a Medicare Advantage Plan or other type of Medicare health plan.You generally have to pay a portion of the cost for each service Original Medicare covers. Theres no limit to what youll pay out of pocket in a year unless you have other coverage (like Medigap, Medicaid, or employee or union coverage) or join a Medicare Advantage Plan. Original Medicare doesn\u2019t cover most drugs, with a few exceptions (see pages 2627, 47, and 51). You can add Medicare drug coverage (Part D) by joining a separate Medicare drug plan. In most cases, you can go to any Medicare-enrolled doctor, other health care provider, hospital, or other facility that accepts Medicare patients anywhere in the U.S. Visit Medicare.gov\/care-compare to find and compare providers, hospitals, and facilities in your area. You generally pay a set amount for your health care (deductible) before Medicare begins to pay its share. Once Medicare pays its share, you pay a coinsurance or copayment for covered services and supplies. Theres no yearly limit for what you pay out of pocket unless you have other insurance (like Medigap, Medicaid, or employee, retiree, or union coverage).\u201d<\/p><\/div>\n               <\/div>\n             <\/div><div class=\"card\">\n               <div class=\"card-header pix-mb-10 shadow-sm rounded-lg bg-white\" id=\"headingpix-tab-b7b6acc-e3d89c6\" >\n                   <button class=\"btn btn-link d-flex text-left\" type=\"button\" data-toggle=\"collapse\" data-target=\"#collapsepix-tab-b7b6acc-e3d89c6\" aria-expanded=\"true\" aria-controls=\"collapsepix-tab-b7b6acc-e3d89c6\"><span class=\"d-inline-flex align-self-center text-primary svg-202 text-20 pix-mr-10\"><i class=\" \"><\/i><\/span><span class=\"d-inline-flex font-weight-bold text-heading-default\" >#2 \u201cHospice Care\u201d and \u201cIn-Patient Medical Care\u201d (Pages 26-27)<\/span><\/button>\n               <\/div>\n\n               <div id=\"collapsepix-tab-b7b6acc-e3d89c6\" class=\"collapse \" aria-labelledby=\"headingpix-tab-b7b6acc-e3d89c6\">\n                 <div class=\"card-body\"><p><strong>Sub-Answer #2<\/strong>: \u201c<strong>According to the passage, long-term care is covered under Medicare.<\/strong> This includes room and board in a facility, as well as short-term inpatient care if it is deemed necessary by the hospice medical team. In addition, Medicare also covers inpatient respite care, which is care given in a Medicare-approved facility so that the patient\u2019s usual caregiver can rest. There is no charge for hospice care, but there may be a copayment for outpatient drugs and a five percent coinsurance for inpatient respite care.\u201d<\/p><\/div>\n               <\/div>\n             <\/div><div class=\"card\">\n               <div class=\"card-header pix-mb-10 shadow-sm rounded-lg bg-white\" id=\"headingpix-tab-b7b6acc-d0c2847\" >\n                   <button class=\"btn btn-link d-flex text-left\" type=\"button\" data-toggle=\"collapse\" data-target=\"#collapsepix-tab-b7b6acc-d0c2847\" aria-expanded=\"true\" aria-controls=\"collapsepix-tab-b7b6acc-d0c2847\"><span class=\"d-inline-flex align-self-center text-primary svg-202 text-20 pix-mr-10\"><i class=\" \"><\/i><\/span><span class=\"d-inline-flex font-weight-bold text-heading-default\" >#3 \u201cSkilled Nursing Facility Care\u201d (Page 28): Describes 3-day minimum stay requirement and cost structure.<\/span><\/button>\n               <\/div>\n\n               <div id=\"collapsepix-tab-b7b6acc-d0c2847\" class=\"collapse \" aria-labelledby=\"headingpix-tab-b7b6acc-d0c2847\">\n                 <div class=\"card-body\"><p><strong>Sub-Answer #3<\/strong>: \u201c<strong>According to the passage, long-term care is not covered by Medicare.<\/strong> This includes care in a skilled nursing facility, which is only covered if the patient has been hospitalized for at least three days. If the patient is in a Medicare Advantage Plan, they may not need to be hospitalized for three days.\u201d<\/p><\/div>\n               <\/div>\n             <\/div><\/div>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-705a5d8 elementor-widget elementor-widget-text-editor\" data-id=\"705a5d8\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Note that sub-answer #1 doesn\u2019t really answer the question clearly at all. Also note that sub-answer #2 states that long-term care <strong>IS<\/strong> covered by Medicare. I believe this is because \u201clong-term\u201d is not defined clearly and GPT-3 interpreted hospital stays of longer than 3 days as long-term (and it probably feels long if you\u2019ve been in the hospital more than 3 days).<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t<div class=\"elementor-element elementor-element-c76c9fa e-flex e-con-boxed e-con e-parent\" data-id=\"c76c9fa\" data-element_type=\"container\">\n\t\t\t\t\t<div class=\"e-con-inner\">\n\t\t\t\t<div class=\"elementor-element elementor-element-3aff3a4 elementor-widget elementor-widget-heading\" data-id=\"3aff3a4\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-default\">Conclusion &amp; Next Steps<\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-10830ed elementor-widget elementor-widget-text-editor\" data-id=\"10830ed\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>Even though different sub-answers come to different conclusions, when GPT-3 is asked to take all three sub-answers and generate a detailed summary of them, it does eventually output the correct answer. This is the GPT+Python answer quoted above. Because sub-answer #1 discusses Medicare in general, the final summary answer also begins with a long discussion of what\u00a0Medicare is before finally discussing long-term care. Unfortunately, the prompt for the final answer (\u201cWrite a detailed summary of the following.\u201d) did not include any reference to the original question. This is probably a design mistake on my part. GPT-3 did not know the question it was supposed to answer and therefore spent a time rambling about things that were not necessarily on-point to begin it\u2019s summary.<\/p><p>You can see a spreadsheet of all the search information results <a href=\"https:\/\/docs.google.com\/spreadsheets\/d\/1Sczwwu6eVJzMj2HUtnC4YsZJ-HYrq2EBPOa9SUoUY5g\/edit?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>. I hope this provided a useful example of how LLMs like GPT-3 can be layered with programming logic to create some interesting custom information systems.\u00a0\u00a0I\u2019ve already made some improvements to this system in terms of optimizing code and prompts such that you can just drag and drop any .pdf file and then ask natural language questions against it via a web interface. I\u2019ll talk about this in the next article.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>Using Language Models to Understand Complex Documents (Part 2: Results) In the previous article I described the architecture of a system that enables a user to ask questions of a long, complex document. As I generate complex legal documents for&#8230;<\/p>\n","protected":false},"author":1,"featured_media":13777,"comment_status":"closed","ping_status":"open","sticky":false,"template":"elementor_header_footer","format":"standard","meta":{"_siteseo_robots_primary_cat":"4","pagelayer_contact_templates":[],"_pagelayer_content":"","footnotes":""},"categories":[27],"tags":[],"class_list":["post-13775","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-legal-tech"],"_links":{"self":[{"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/posts\/13775","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/comments?post=13775"}],"version-history":[{"count":13,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/posts\/13775\/revisions"}],"predecessor-version":[{"id":13818,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/posts\/13775\/revisions\/13818"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/media\/13777"}],"wp:attachment":[{"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/media?parent=13775"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/categories?post=13775"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/prizmlaw.com\/site\/wp-json\/wp\/v2\/tags?post=13775"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}