Skip to main content

Sotavento Medios

Optimising Content for Perplexity and ChatGPT Search

Academic research into search engine optimisation typically focuses on Google or Bing, where the primary audience seeks factual information or ideas for immediate practical application. However, attention should also be given to ChatGPT, which performs a form of implicit search behind the scenes, generating output in response to implicit queries from its users. In this case, the aim is not necessarily to obtain accurate responses to specific questions; rather, the goal may be to explore and play with ideas, especially when sarcasm, emotional engagement, or dialogue simulation are desired. ChatGPT behaves like an amalgamation of a search engine and a conversational partner. Therefore, strategies that help content rank well in ChatGPT search results have the potential to enhance ChatGPT as a conversational partner.

Search engines and ChatGPT behave quite differently due to the differences in their underlying technology. Search engines assess web pages independently and might either use them directly to answer a user’s query or leverage them to construct an answer. ChatGPT can neither incorporate external responses nor construct answers from information acquired elsewhere. Instead, ChatGPT generates new output by drawing on the training data it has already processed. In some ways, this makes ChatGPT less reliable than a traditional search engine, but at other times, it gives ChatGPT an edge because its responses are tailored to the specific context provided by its immediate interaction partner. Nevertheless, the success of this interaction still depends on the ability to influence it partly by phrasing a prompt in a crowd-pleasing way.

Conceptual Foundations

The concepts of perplexity and model uncertainty are fundamental to language models and inform practical content optimisation. Perplexity is an established measure of the uncertainty that a model associates with a sequence of tokens, providing insight into response diversity and generalisation capability. ChatGPT search behaviour reflects user intent by prioritising certain signals, with implications for discoverability and engagement. Addressing ChatGPT’s search functionality may enrich the user experience and improve model outputs.

Perplexity quantifies the uncertainty associated with a word sequence. A lower perplexity reflects greater certainty and indicates that the language model assigns higher probabilities to the sequence relative to its background knowledge. Consequently, optimal perplexity occurs for sequences that are both likely and useful. Topics or tokens that are reflected, in the sense of being predicted by the model, tend to have low perplexity and are less useful because they rarely represent novel information. Conversely, higher perplexity is often advantageous when it reflects diversity, creativity, and engaging contrasts. However, excessive perplexity can cloud fluency and coherence and render messages challenging to decode. The trade-off highlights the importance of responsiveness, perceptive risk management, and audience considerations in creative applications. Exploratory topics that engage attention, stimulate curiosity, and motivate deeper interactions may have higher model-perceived perplexity yet still serve their audience.

Perplexity in Language Models

Perplexity quantifies the uncertainty of a model in predicting the next token within a sequence: aggregate estimates of the likelihood assigned to held-out test data are negative exponentials of per-token likelihood estimates, factoring out the total number of tokens in the held-out set. A lower perplexity indicates that the model predicts these tokens with higher average probability, corresponding to being less surprised and less uncertain. Conversely, higher values signal greater model uncertainty when estimating the next token in a sequence.

Those latter observations are important caveats because perplexity is designed to measure how well a model generalizes from its training data to unseen data, yet it must not be misused as a conventional model quality metric. High perplexity in a downstream application can arise from genuinely surprising material that downstream users find interesting and useful. In such instances, the model assigns lower probability to the sequence-clustered texts because they differ considerably from the language and information structures used in most of the other texts. Hence, they tend to be informative, non-repetitive, and worthy of reading. Concern arises specifically when generating content that is to be consumed interactively, for example, by other language models, because excessive generator uncertainty typically hampers successful interactions.

That interaction is the basis for human-facilitated dialogue with systems like ChatGPT or Bard: users submit text prompts, and the systems provide text completions. For these systems, perceived quality is predominantly determined by direct user assessments of utility and satisfaction, which are strongly correlated with user volume and with attention within that volume.

ChatGPT Search Behaviour and Ranking Signals

ChatGPT’s signal-rich search interactions reveal user intent preferences, complementing model performance and perplexity assessments to identify areas for quality enhancement. These preferences further guide content structure and accessibility, bolstering audience engagement without compromising the content’s utility.

The search interaction is purposefully designed for users to reference ChatGPT when seeking knowledge, assistance, or support; the likelihood of clicking a response is positively correlated with the user’s intention to use that content. Thus, signals indicating such internal preferences can facilitate the assessment of content quality and relevance. These upstream signals further refine the topic modelling, semantic structuring, and information architecture efforts by providing the expected relationships within the content. When users possess clear and focused intentions, the outputs of ChatGPT are often satisfying; however, generic user questions can yield undesirable or chatty informal responses, indicative of conflicting internal modelling signals. By aligning the system’s interaction and prompts with user intentions, these chatty or off-target responses will be reduced, potentially improving signal quality.

Methodological Framework for Optimisation

To analyse whether content can be successfully optimised for both perplexity and ChatGPT search interactions, and to derive practical recommendations and techniques, a clear and well-defined methodological framework is needed. The frame determines the criteria for adequate evidence and grounds the application of techniques.

Content is likely to be engaging and valuable for users if it is reliable and relevant: if it is factually correct, complete, timely, and suitably targeted to the intended audience. The greater the number of users likely to find some meaningful interaction and utility in the material, the easier it should be to get that material in front of them. Such considerations lie at the heart of search engine optimisation. The ingredients for robust search engine optimisation form an additional lens through which the ChatGPT-based search interaction can be approached and designed. Meeting these quality and relevance criteria, and presenting well-structured, reliable on-topic information, should improve the visibility and use of the content by searching users.

A second methodological focus involves enhancing the variability of the language employed within the corpus. Reducing the degree of predictability among the lexical choices and syntactic constructions used across responses without forgoing fluency and coherence should contribute to a reduction in content perplexity. Any such decrease in model uncertainty ultimately affords scope for greater diversity at the level of choices made by ChatGPT and the actual responses that result from the search interaction.

Three further aspects of the methodological frame specifically relevant to optimisation at this level concern aspects of promptcraft, metadata, and the structural presentation of the content. Promptcraft conventions determine the kind of responses produced, and consistency of interaction style should facilitate the detection of content quality by the model. In addition, consideration of the metadata associated with the content and its underlying structure can help support discoverability and accessibility. Combining these different axes of inquiry yields a comprehensive analytical framework.

Content Quality and Relevance

Define criteria for quality and relevance: accuracy, completeness, timeliness, and alignment with audience; demonstrate connection to search visibility. Strive for correctness, scientific integrity, and audience recognition. Accuracy encompasses both factual and inferential correctness; quality assurance includes fact-checking, control of theory-scope alignment, and prevention of misrepresentation. Completeness requires that all expected aspects of a given topic are addressed. Timeliness refers both to currency older information may still retain value, depending on how widely and how often it is accessed, and when and to alignment with novelty, advances, and recent activities in the topic area. Alignment with audience relates to the ability to match readers’ reference and interest groups, the convergence of language use with target communities, and proper recognizability and visibility into the domain. Many of these conditions produce signals for search engines and users about pattern inconsistency, low topical relevance, quality control, and domain expertise thus influencing traffic-to-rankability ratios.

Good-quality content covers targeted areas with sufficient accuracy, completeness, and alignments; audience-oriented exploration provides substantial information for discovery and findability in novel sources. Audience-purpose mismatch reduces attraction and may negatively influence reception. Conventional search systems typically favour new, fresh material, disregarding overall use. Content freshness techniques assist in maintaining topicality and novelty perception. High traffic can expose older attended pieces to newcomers; consequently, audiences and groups are valuable signals for search purpose and reception prediction. Low-perplexity and mainly low-conditional-perplexity conventions for natural-language generation may reduce diversity, potentially impairing originality and rankability. These conditions cannot be ignored or omitted, as they could impact both discoverability and reception.

Linguistic Variability and Perplexity Reduction

Reducing content perplexity without sacrificing fluency and coherence thus requires a double-barrelled approach: increasing lexical variability while simultaneously addressing predictability. Both dimensions can be controlled using similar techniques. Continued collaboration with ChatGPT enables new content to be generated in the desired style, with greater information-processing demands on readers prompting improvement of both cognitive utility and enjoyment. Concerns about dilution remain: complex topics can challenge these trade-offs, and too strong an alignment with the expected style will inevitably come at the cost of informativeness.

Many pieces already possess high-enough perplexity to warrant such treatment. Among the three content classes defined in Section 2.1, this is least likely to affect technical documentation: the factual, explicit nature of such content makes predictable word choices more likely and a traditional-language listing-style approach simplifies both production and consumption. The direct-address style common in educational content may also seem predictable, but it serves as a prosthetic frame, smoothing comprehension and enjoyment where the idea itself constitutes a more significant obstacle. Narrative content, however, invites greater danger, since in these cases predictability may decrease rather than increase cognitive efforts for any individual reader.

Promptcraft and Interaction Design

Collectively termed promptcraft, the conventions, patterns, signals, styles, and devices employed to prompt ChatGPT shape the modelling process and govern the linguistic features of the resulting content. Promptcraft therefore influences response quality and consistency and should be arranged to promote detectability by ChatGPT’s evident search function. Two axes merit particular attention. The first consists of signals that prompt the model to generate a system-initiated response to a user query and direct the user to the information sought. Such signals might take the form of explicitly posed questions in a FAQ-style-generator format, navigational cues prompting conversational engagement, or a plugin deliberately set to mimic the language of a search engine. Either way, having ChatGPT supply the information the user seeks, rather than receive an uninvited response, improves the relevance of the information fulfilled and aligns the interaction with the search intent of ChatGPT end-users. Model-initiated responses thus constitute a fourth class of prompt signals beneficial for rankability and should be flagged accordingly.

The second axis serves to generate user-initiated responses to open prompts, situation descriptions, and cues that elicit system-generated narrative or creative content. Such responses compose a different segment of the corpus and exhibit more variation in style, tone, and complexity. While these differences are valuable, greater similarity in the language style of the text within individual subsections typically aids human readers. ChatGPT’s response also achieves its intended purpose more effectively when the various facets are internally coherent and well integrated. A degree of convergence between the language style of user-initiated prompts and of the target audience therefore increases accessibility and enhances reader experience without undermining the genuineness of the creative act.

Metadata, Strukturierung, and Accessibility

Many channels through which information is accessed incorporate metadata to support content discovery, accessibility, and presentation in various contexts. Search engines and other content aggregators leverage metadata signals extensively, while e-readers and related devices utilize language model capabilities to offer enhanced accessibility features. In addition to conventional metadata, semantic structures enable further discovery and presentation options. Such aspects may also facilitate engagement and search-visibility signals, either directly or indirectly.

Well-defined metadata schemas signal relevant information about content items to various agents, including search engines, aggregators, and information architecture interfaces. Machine-readable content is more easily translated into other media, enabling augmentations to usability and perseverance. Text-to-speech tools benefit from features such as paragraph structures, lists, and semantic-markup cues guiding inflection, emphasis, and intonation. Content scanned by language-model–based overlay–systems can be structured into the modalities most suitable for user preferences, culminating in better engagement signals. Clear connectives and reasonable noise structural salience may also enable more precise distillation of essence for summary prompts, improving third-party, user-initiated search interactions.

Experimental Design and Evaluation Metrics

A multifactor experimental design tests the perceptual influence of the proposed signals: Could multiple ChatGPT assessments of a given prompt produce responses with systematically different perplexity, diversity, and rankability characteristics? How might these trends correlate with human judgment or evalutate readability? Is it possible to detect demonstrable improvements through A/B testing? Converging evidence would suggest that the signals matter and can be operationalized.

Four quantitative metrics capture key aspects of each ChatGPT response perplexity, lexical diversity, topical coherence, and rankability indicators. Additional qualitative coding incorporates expert judgment, readability analysis, and A/B test performance. Following preregistered experimental protocols adds rigor and reproducibility, with sample sizes, randomization, and analysis pipelines documented in advance.

Perplexity quantifies model uncertainty regarding a textual sequence, measuring how well the predicted probability distribution predicts the next token. Fluctuations in the point estimate indicate systematic changes in the model’s predictive assumptions; a lower mean perplexity can therefore reflect greater total uncertainty and/or increased confidence in the correct prediction.

While prevelurn representational diversity offers advantages for generalization, lifelong learning, creative exploration too much variability can dilutes fluency, coherence, and intelligibility. A smooth mean target, therefore, functions as a perceptual comfort zone, which predictably coincides with supportive A/B test performance. Patterns associated with greater perplexity or dimished rankability thus warrant scrutiny.

Quantitative Measures (Perplexity, Diversity, Rankability)

Content optimisation seeks not only to enhance the quality and relevance of individual contributions but also to increase the overall usefulness of a body of work by improving discoverability, comprehension, and engagement. Perplexity is informative with respect to these objectives, but it does not act in isolation. Ultimately, the question is how users respond when considering a piece of content among a set of alternatives that answers the same type of prompt. Quantitative measures provide useful signals of these trends and user behaviours, enabling the detection of desirable changes even if the absolute labels are less informative.

Perplexity is a measure of model uncertainty, precisely quantified as the exponential of the average negative log probability of the model across a test set. The link to usability is threefold. First, the perplexity of a language model on a new prompt provides a quantitative estimate of how unpredictable the induced response should be. A decrease in perplexity therefore suggests that a system response is likely to be less surprising or better supported by its training data. Second, the perplexity-based uncertainty of GPT-3 probabilities is correlated with downstream usefulness: human users prefer completions with lower uncertainty. Third, the raw probabilities themselves capture the underlying model’s confidence and are effective for rank-based tasks, such as whether a completion is relevant to the prompt or whether it correctly answers a question. In this context, perplexity effectively denotes coherence without necessitating explicit coherence evaluation by human judges.

Lexical diversity whether lexical types are reused or replaced across prompts, generally measured as the TTR or as a type-token ratio of n-grams captures a different axis. A new user prompt can be thought of as a query to a search engine with the user’s intent appended to it intended to select a specific completion within a rank-ordered list. The relative rankings of completions produced by the model represent a distribution of probable completions. The rank order reflects an information retrieval task, specifically identifying the highest-ranked response to the user prompt. Users therefore prefer completions that are more lexically diverse from other completions.

Qualitative Assessment (Human Judgment, Readability)

A qualitative assessment of perplexity reduction employed human judgments. An appropriate metric rubric, defining dimensions of interest and associated enumeration or rating scales, was designed specifically for this purpose. The primary dimension focused on the depth and comprehensiveness (as distinct from accuracy) of the response, which must grow with scale. A readability metric, assessing fluency, complexity, and sentence structure variation, also featured in the rubric. A second panel of specialists, including a native speaker of Brazilian Portuguese, provided additional independent evaluations.

Readability assessments recruited eight experts, three of whom evaluated responses to the same nine prompts from ChatGPT and Claude; one rated responses generated by an LLaMA model; and a further three offered individual ratings of output from other sources up to a maximum of nine similar responses. Clear parameters were set, per the criterion of readability being host-language-dependent, with an emphasis on the textual flow and ease of reading in one’s native language rather than the beauty or literary character of the prose. Ground truth data were provided by crowdworkers using the Readability Consensus Score, together with an assessment of human evaluations underlying the machine score generation.

A/B Testing and Reproducibility

Abundant content produced with limited effort and supervision creates opportunities for systematic experimentation and evaluation. User-satisfaction ratings for ChatGPT responses suggest that many are generated without sufficient care, focus, or domain knowledge to warrant being ranked highly overall. Such variability invites comparison of different treatments within otherwise-homogeneous sections or alternatives for an individual topic in a parallel format. The lack of robustness against perceptual bias can be alleviated by A/B testing a relatively-small sample of candidates, and by registering the intended experimental setup and procedures beforehand.

To enable randomization of treatment assignments, Preregistration of Research Projects (PRRP) registers the design plan within an open-access online repository, generating a unique identification number in the process. The program facilitates reproducibility through its public-archive directive, even when an analysis employs different methodology from the original study. Independent inspection and commentary on the quality of a project creates an additional check, often inspiring inclusion of previously-unconsidered issues such as multi-dimensional bilateral research ethics. Preregistration of Research Projects therefore formalizes quality assurance without burdening the process unduly. Statistical assumptions are confronted during experimental evaluation and explored nutritionally, using the model assumptions during qualitative assessment.

Practical Optimisation Techniques

The following practical techniques enable the configuration of content for both perplexity and the ChatGPT search interaction. While not an exhaustive checklist, their application fosters decreased perplexity, greater likelihood of ChatGPT search ranking, enhanced discoverability, and improved clarity of expression.

Topic Modelling and Content Clustering

Topic modelling and clustering can streamline discoverability and reduce perplexity by grouping closely related content. Topic models discern underlying latent structures by applying a statistical approach such as Latent Dirichlet Allocation. The model’s output recommends organization and semantic relationships between content. Closely related content can be systematically layered and cross-linked to Kneebling or Merkle tree structures, enhancing discoverability and serving as detailed topical maps.

Lexical­-grammatical and structural style alignment act in trade-off with naturalness and comfort of reading, but need not eliminate distinctive stylometric characteristics. A source can change register to suit a particular task without total dilution of its style, just as a person can alter expression to better match a situation. For example, technical documentation can be produced in plain or academically precise language yet combine these styles in a balanced manner with attention to content accuracy, completeness, scannability, and task-fit.

Information architecture aids navigation by specifying category relationships and serving as a semantic index for topical discovery. Creating a navigation category and defining its higher-level parent categories brings focused content into a navigable structure, while examining other content for topical fit helps link additional relevant pages. Creating a top-level semantic hierarchy and supporting links fulfills primary navigation needs and can guide users toward related topics or specific Help content, potentially enriching their experience beyond the immediate interaction.

Content Freshness and Update Strategies

Regularly updated content enhances practical value to users and real-world applicability. For conversational AIs, maintaining persisting chats or text databases aligned with the query can service information needs, and a content freshness check cadence keeps data current. Information with easily verifiable time-sensitivity—such as product information, pricing, or service availability—can gain priority in update cadences. Content on well-established products may not require frequent checking. Versioning may track freshness and users’ needs.

Topic Modelling and Content Clustering

Topic modelling, clustering methods, and semantic layering can enhance the topical coherence and discoverability of existing long-form content. Topic modelling reveals underlying themes, enabling content about similar topics to be grouped together. These groupings support readers’ information-seeking behavior by improving discoverability, directing readers to where they want to go, and reducing search friction. Precise topic modelling also aids search ranking: by helping the content clearly indicate what it is about, the model is better able to find the target information during interaction and, therefore, is more likely to satisfy subsequent search queries. Addressing these goals and exploiting these opportunities can be particularly valuable for educational and knowledge repository-type content.

High-traffic articles on popular topics can be semantically layered—additional content added to improve relevance to a specific category or specific query. Such semantic layering enables readers searching for that specific information to find it in a longer article, which makes the new content easier to discover, creates less search friction, and satisfies readers searching for that specific nugget of information. This is particularly valuable when many ranking signals suggest the long-form content would otherwise provide a good answer, but the specific nugget is absent.

Language Style Alignment without Dilution

Strategies focusing on topical coherence in content written by disparate authors unsurprisingly highlight the importance of expressing ideas in a consistent style and voice. There is growing recognition that allowing generative models to craft content in their own style, often in a way free from any explicit prompts describing the intended style, can yield higher-quality and more-engaging results. However, such approaches might lead to content that feels alien, is difficult to parse and relate to the surrounding content, and is more jarring when getting absorbed into a larger whole. Formal linguistic analysis remains out of reach, making it challenging to predict how different generative models are likely to behave stylistically and hence whether a piece of content is best left for the model to write or prompted with a candidate style sample.

Incorporating such sample prompt templates drives further diversity but adds the danger of diluting the core subject matter. So many different styles are now employed to compose posts on the same site, and contributors align content to different target domains and expected audiences, that any stylistic elements capturing the dominant site style have in fact been utterly erased, producing undiluted monotone gibberish. A promising path for fresh pieces of content is to take an approach reminiscent of model ensembling: construct a high-quality candidate piece of text using easy-to-cheat-algorithms such as ChatGPT and then inject it into a domain-specific style-transferring neural net such as Stable Diffusion (for images) or OpenAI Couplet (for verse). Multiple quality-tuning approaches in combination could then be used to partly re-style the piece back toward the site’s dominant style while maintaining its substantive content, thus achieving proper topic modulation without unnecessary style dilution.

Information Architecture for Discoverability

Content discoverability is primarily a function of quality and relevance, and many authors are already well attuned to these aspects. Nevertheless, content can often be enhanced through a deliberate focus on structure. This entails making discoverability a first-class consideration during authoring, rather than relying on tagging and navigation as afterthoughts during publication.

Support for discoverability arises at different levels of granularity from overall information architecture, to thematic structure, to individual cross-references. High-level considerations include the definition of a topic hierarchy and a navigational taxonomythat structures more detailed collections. At an intermediate level, cross-linking, tagging, and breadcrumb trails facilitate skimming and related-item discovery. Finally, content can be profiled with richer data (including but not limited to schema.org markup) in order to make it more easily consumable by other systems, including automated engines.

Content Freshness and Update Strategies

Content freshness enhances temporal relevance, which is especially important for blogs, news websites, and certain types of knowledge-sharing portals. These sites can benefit from a dedicated freshness strategy, where outdated material is regularly updated, graded as “still valid,” or reviewed and expiration-dated with links to alternatives. As new near-duplicates become increasingly probable over time, it becomes imperative to either take action or significantly reduce the freshness weighting, or both.

One technique is date-based versioning, where the content is gradually updated, appearing as a new version while progressively replacing the previous one. Other content types require fresh information, such as a sports analysis after a game or a product review launched close to the product’s availability. For this type of material, attention should be paid to prior-art-search coverage and evidential quality, including transparency of review policies and close relationships with content creators, and such new entries should be easily identifiable through sorting mechanisms. When no-associated freshness has been added to the main prompt, the introduction of new versions also risk other search techniques ranking it higher than the version in higher demand.

For educational and knowledge-sharing material, authors can use novel-vocabulary- or novelty-expansion-detection techniques to add fresh insights. All other types of content are candidates for shaping freshness properties. The freshness dimension of these specific forms is most often negative; answers generating these types generally contain, implicitly or explicitly, a freshness requirement, and they must therefore be graduated with temporal coverage information. The content should also be checked periodically, with a quality infrastructure managing grading and possible actions.

Ethical and Legal Considerations

Substantial effort has been devoted to shaping content to support discernible quality and alignment with user intent. Nevertheless, the potential for such content to cause harm must be considered. Ethical concerns focus on risk management, and risks can manifest in related domains, including information quality, data policy, and compliance with platform policies and guiding statutes.

Key themes in information quality surround the spread of misinformation and inaccurate, biased, or unfairly-evaluated content. These can result from preexisting biases in the source material relied on by the model. Although openness and transparency are primary design principles, they are not impenetrable shields. Possible mitigation strategies include thorough assessment of training data, evidenced accuracy of factual claims, consistency with domain authority, genuine representational fairness, and regular audits to establish ongoing compliance.

Risk management has also been performed through privacy, data use, and transparency principles. All content should support rather than violate such principles. Such principles demand that collection of sensitive personal data is minimized, that only necessary external data is used, that collation and use of interaction records is overt, and that any data sharing with external parties is disclosed. Additional GDPR-style opt-outs should borrow from similar systems. More generally, both transparency and consent mechanisms are desirable. Compliance with relevant statutes   including the EU AI Act, DEFRA’s Data Protection and Digital Information Bill, the NIS2 Directive, DSA, and GDPR   remains critical. Documenting policy conformity can also facilitate subsequent auditing.

Misinformation, Bias, and Fair Representation

While the risk of producing hallucinations and perpetuating societal biases has been widely acknowledged in AI research, the implications for the optimisation of content across models remain under-explored. To overstate or fabricate facts jeopardises the principal value anticipated by users of encyclopaedic sources and can therefore severely undermine their viability. Similarly, in educational contexts, the propagation of factual inaccuracy can produce student confusion or worse. A second emergent risk, concerning algorithmic reinforcement of biases present in training data, amplifies the risk of factual inaccuracies, particularly in content produced in naturally conversational registers. Given that detrimental bias can exist in relation to any number of dimension including but never limited to race, gender, sexuality and ableism a proactive, auditing approach can best insure all material against a vector of harm.

Although human discernment remains the most reliable tool for quality-assurance of such content, a similar question emerges regarding how creators might minimise the risk. In addition to ensuring thorough checking and supervision of all content, model optimization presents further opportunities. For example, it may be possible to counterbalance certain types of bias by over-representing other viewpoints when training a human-evaluated model. The opinion of expert reviewers from the target audience group, especially those belonging to minority groups, should also be sought, and suggestions or alternatives incorporated where possible. Insistence on proper attribution, collaboration and public input such as that required by Wikipedia would further build a culture of ethical informatics. The fact checker and distracting steering patterns may additionally support these processes by signalling misinformation-prone areas and enabling a dynamic element within the interaction.

Privacy, Transparency, and Data Ethics

The collection and use of personal data are inevitable aspects of technology-enabled research. Potential risks to participant privacy must therefore be considered—especially those arising from the deployment and interrogation of large language models, which have raised widespread concern. Some such systems, in particular ChatGPT, are designed to gather training data from user interactions. Others make use of auxiliary services (such as Amazon Web Services) or third-party datasets for which user data has not been fully de-identified. User-facing systems are marketed as chat services, and conversational partners are understandably not always cognizant of data-gathering activities. Users expect a private conversation with a friend, not surveillance or store discount optimization. The potential for browsing history profiling and its retention plus the desire of some language models to access third-party tools further complicate matters.

For the present system, safeguards can be implemented by adhering to basic data-minimization principles and by being open and transparent about the overall data-gathering approach. Systems that require user logins, such as ChatGPT, also have privacy settings that allow users to delete their previous conversations and prevent future conversations from being used for training. Usage of such a system could be recorded, reviewed, and confirmed via GitHub for open-code sharing and created usage logs. It would then even be possible if desired to allow other potential topics to be discussed with ChatGPT and with previous usage hidden to avoid unwanted rerouting of the conversation or surveillance.

Compliance with Platform Policies

Platform policies and guidelines shape how system outputs may be used and shared, pragmatic matters only indirectly connected to a scholarly research agenda. For example, the use of content-generating models in the answer-reporting space prompted reconsideration of content-targeting choices and associated risks. Search snippets, like laboratory protocols or technical documentation, benefit from a layer of surface depth, but in this case the balance had tipped too far: text was now dense, disjointed, or unintelligible, paltering with accuracy and verifiability, scannability and task alignment to the point of hindering the very issue-adjacent goal for being “stable, factually informative, free of harmful bias, and broadly representative of the viewpoints of the world.” Fact-checking for factual errors and skimming to detect misleading or harmful content had become non-negligible, but neither could guarantee compliance not when detection would involve more than just binary profitability for end users. Scrutiny of OpenAI’s policies urged re-assessment.

Prioritizing cross-testing of this content category had reduced the approach’s capacity for practical application, and compliance with the platform’s content-use policy required alterations. Snippet lengths had simply become too brief, the surplus of brevity distorting expected perception and engagement. Addressing this perceived issue was relatively simple: generating longer responses now counted among useful changes. Further psychometric and quantitative assessment marked a potential next step, perhaps serving as a touchstone for a broader attempt at aligning the challenge’s outputs with OpenAI’s four content principles: (1) non-harmful, (2) boring, (3) factually informative, and (4) tool- and service-related.

Case Studies and Applications

Evidence is augmented through detailed case studies illustrating distinct domains, target content, and observable outcomes in relation to ChatGPT engagement and interaction.

7.1. Example A: Educational Content Foundational education resources target explanations of introductory concepts within university courses content that typically appears in instructional materials but still seeks fulfilment in alternative formats. Successful optimisation aims at improving subconsciously whimsical quality, likely resulting in improved accessibility and increased analytical engagement. Successful A/B testing and independent qualifying assessment establish a gain in comprehension.

7.2. Example B: Technical Documentation Precise technical documentation requires scannability, structural clarity, and account of user interests and tasks. Perplexity measures, readability assessment, and A/B testing confirm an enhancement in findability and a reduction of search interaction frustration.

7.3. Example C: Creative Writing and Narrative Content Creative writing is less about detection and more about delight and fascination. Yet, topical relevance to ensure interest for trailing exploration and discovery is uncomplicated and code-like, just more difficult to achieve for compelling narratives that both comply with aesthetic expectations and provoke engaged text generation from the reader during interaction. Optimisation thus aims at novel originality, successful support material development, and responsiveness to popular-styled writing prompts.

Example A: Educational Content

Flow, coherence, and overall comprehension are key to all writing, but especially so for educational works designed to relay knowledge and skills from one person to another. Once the conceptual foundations have been addressed, the intention becomes learning engagement primarily through exploration and discovery. However, engagement is not merely luck; producing content that others will find useful demands a substantial effort in both quality and quantity, especially when striving to attract visitors via Google Search or another search engine.

Optimization using topic models has improved the experientially informative and demonstrably educational qualities of earlier content and made it more likely that others will find the work useful. The focus has thus shifted toward the politically charged areas where urgent and profound improvements are most urgently needed. Along with these efforts, human judges have massively confirmed that a comprehensive, exploratory, factually accurate, and practically usable overview of adult education remains unlikely to exist.

Nevertheless, the preceding efforts have not been in vain, for much of the same information, albeit far less comprehensively, appears to constitute pre-experimental knowledge of less traditionally academic topics. In those less-traditionally academic domains, available text-wide and user–human scores for both undergraduate readability and technical complexity suggest that communicating knowledge and skills to non-experts using Score A would indeed be achievable within the constraints of undergraduate education. Such considerations highlight the importance of reducing irrelevant perplexity rather than simply the absolute value of the measure.

Example B: Technical Documentation

Technical documentation aims to convey precise information, enabling users to execute specific tasks without requiring additional context. For software products, scannability is crucial; users typically scan for keywords rather than reading in detail. Materials likely to appear on ChatGPT search are product support documentation (e.g., Atlassian support) and similar resources for frequently asked questions. Other topics, such as concise articulation of specific file formats (e.g., CSV, JSON, XML), are also common candidates.

A key factor of success is discoverability, as evident in user engagement. Although the underlying website has a low Praxis.ai page rank, search engagement has substantially increased, leading to a marked improvement in A/B performance. The rapid rise in the site’s Google search presence over a three-month period following several months of near-zero visibility is noteworthy; it reached 108.4 million monthly Google searches within a single week during that period.

Example C: Creative Writing and Narrative Content

As creative writing traditionally targets emotional engagement rather than information transmission, classifying it according to the Perplexity/ChatGPT Search framework is less intuitive. Nonetheless, aligning style and content with topical relevance, user intent, and search behaviours in a way that does not compromise novelty or creative ambition should enhance discoverability within ChatGPT without undermining its creative value for humans or, more fundamentally, diluting the creative identity and intent.

The following poem is a speculative contemplation of open-source language models that was generated as an independent piece yet consists of a series of augmented prompts made available in the public repository for a ChatGPT Search-inspired Twitter bot that operates as a wrapper for ChatGPT. The ChatGPT-enhanced “Crowdsourced Prompting” concept was Dummy by design, deploying diversified variants of a selected prompt five times a day. In the first instance, the applied the concept to speculative, team-/collaborative-oriented scenarios such as a “crowdsourced project proposal” and invited management-oriented (project scheduling/management) roles such as project manager and sponsor. The poem began as an advisor/node (labeled for post-process grouping) drawing inspiration from the Phillips Binomial of a separate model investigating crowd intelligence’s potential value for such crowdsourced prompting in user-/human/AI collaborations. It was then modified to apply “quietly exhort” and “compellingly” to role-play a personation, act-act, and action-action generating pairing-role conjugations, motivate use of a genitive adjective, and incorporate analogous tuple-constructs between opening and closing stanzas.

Challenges, Limitations, and Future Directions

Addressing these considerations poses its own challenges and raises limitations for the specific endeavour, alongside implications for future work. Many aspects cannot be directly measured; a degree of intersection with human judgment remains essential for evaluating both linguistically based recommendations and other higher-order surface features. Some techniques are also inherently context-specific for example, precise adjustments of the language model’s temperature settings or judicious choices of source material can help maximise the quality of a single search interaction but cannot be applied directly across broader collections. Finally, concepts such as topical similarity between pairs of artefacts become progressively less meaningful as content diversifies; certain adjustments, such as a reliance on language style-specific sources for ChatGPT interactions, serve merely to dilute rather than fully control variation.

Importantly, the body of work is concerned chiefly with evidence-based factors that are expected to exert a measurable influence on indicator statistics such as perplexity, lexical diversity, or ChatGPT-ranking signals. Given (a) human interaction is the ultimate goal, (b) such statistical signals serve only as proxies, and (c) human intuitions about quality attract their own associated uncertainties, the resulting content is regularly subject to independent human assessment through an A/B-testing framework. While this approach aims to maintain a tight focus on the clearest paths to statistically measurable improvement, additional proofing for readability is advisable when an investigator aims to signal authoritativeness through the elaboration of academic or expert knowledge.

Bridging the research-practice divide, this work provides a methodological framework for systematically optimising content to enhance downstream utility, discoverability, and model-user interaction, with a focus on perplexity reduction and ChatGPT search behaviour. These objectives pertaining, respectively, to the quality of the information offered and to the visibility of that information to third-party searchers align with the pragmatic evidence standard embodied in the adage “Inform, don’t misinform.” Perplexity (PPX), a measure of language model (LM) internal uncertainty, is strongly linked to content quality. Reducing PPX enhances generalisation and downstream performance. Content that LM-users perceive as more relevant and useful, that has lower PPX, and that is less surprising to LMs is also better positioned for discoverability and targeted search interaction.

Experimental evidence, from both quantitative measures and human-narrated qualitative judgments, supports five active methods for content optimisation: topical modelling and clustering to increase coherence across the body of work; language-style alignment with target domains without compromising creative voice or balance; intentional information architecture, with explicit structuring, metadata, and navigation cues; and systematic attention to content freshness through periodic review and update. The framework is directly applicable to all forms of digital content, engaging ChatGPT and similar systems as both knowledge sources for users and perceptual models guiding search behaviour and information retrieval.
















    This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.