Tag Archives: algorithms

Leveraging Combined Credit–Debit Data to Reveal Borrowing Patterns and Improve Delinquency Prediction Models

A recent article in The Journal of Finance and Data Science reports that combining customers’ credit card information with their debit account transactions markedly improves the ability to forecast credit card delinquency. The study, carried out by Håvard Huse of BI Norwegian Business School, Sven A. Haugland of NHH, and Auke Hunneman of BI, introduces a hierarchical Bayesian behavioural model that consistently surpasses prominent machine-learning systems, including XGBoost, GBM, neural networks, and stacked ensemble methods.

Huse notes that relying solely on credit data offers only a limited view of an individual’s financial circumstances. By incorporating debit-side activity, the researchers gain visibility into payday-driven spending, repayment routines, and patterns in income flows—elements that play a decisive role in whether a customer may struggle to meet payment obligations.

Their analysis draws on granular transaction-level data from a central Norwegian bank. Where standard credit-risk models depend predominantly on monthly summary indicators such as balances or credit limits, these traditional markers reveal little about the day-to-day financial habits that underpin repayment outcomes. By modelling behavioural trajectories—how repayment behaviour shifts over time, or how expenditure rises immediately after payday—the new framework provides a richer explanation of both the mechanisms behind delinquency and the individuals most likely to default.

The model’s advantages extend to its ability to generate more precise predictions for individual customers. It also uncovers distinct behavioural groups characterised by differing “memory lengths”, referring to how strongly past financial states influence present repayment patterns. According to Hunneman, customers under financial strain tend to be more affected by their earlier behaviour, and this dynamic is captured far more effectively by the Bayesian specification than by conventional machine-learning tools.

A further strength of the approach lies in its interpretability. While outperforming cutting-edge algorithms, the model remains transparent enough for practitioners to understand the behavioural drivers of risk. As Hunneman observes, accuracy alone is insufficient for financial institutions; they must also be able to trace the patterns that shape customer vulnerability.

The authors illustrate the model’s practical significance by showing that, over a three-month prediction window, financial institutions could realise considerable savings by identifying at-risk cardholders earlier and taking timely action. Haugland emphasises that this improvement is not just a technical gain in predictive power but a means of offering more proactive support to customers who might otherwise slide into serious financial difficulty.

Together, these findings signal an essential evolution in credit-scoring practice: a movement away from static, aggregate measures toward deeper behavioural analytics grounded in the full spectrum of customer transactions.

More information: Håvard Huse et al, Integrating credit and debit data for enhanced insights into borrowing behavior and predictive modeling of credit card delinquency, The Journal of Finance and Data Science. DOI: 10.1016/j.jfds.2025.100166

Journal information: The Journal of Finance and Data Science Provided by KeAi Communications Co., Ltd.

Personalised AI Pricing May Undermine Consumer Interests

The autonomous operation and adaptability of artificial intelligence (AI)-driven pricing algorithms have made them an increasingly valuable tool for firms seeking to optimise pricing strategies in fluid and competitive markets. These systems can dynamically adjust prices in response to real-time market signals, including demand fluctuations, consumer behaviour, and rivals’ pricing strategies. Their promise lies in enhancing efficiency and revenue optimisation. However, their growing prevalence has raised concerns among scholars and regulators alike. A central issue is that specific pricing algorithms have demonstrated the capacity to learn tacitly collusive behaviours—coordinating pricing in ways that suppress competition without explicit agreement. This can result in inflated prices that ultimately harm consumer welfare, prompting calls for stricter oversight and more thoughtful algorithmic design to ensure competitive outcomes.

A recent study published in Marketing Science by researchers at Carnegie Mellon University investigates how the structure of product ranking systems on e-commerce platforms influences the pricing behaviours of AI algorithms. While using personalised product rankings—those tailored to individual consumer profiles—is generally perceived as enhancing the shopping experience by reducing search time and improving product relevance, the researchers raise a compelling question: could such personalisation inadvertently enable firms to charge higher prices, thereby reducing consumer welfare? Notably, the study focuses not on traditional price discrimination but on whether personalisation in the ranking can distort market dynamics, even when identical prices are shown to all.

Param Vir Singh, Carnegie Bosch Professor of Business Technologies and Marketing at the Tepper School of Business, explains that the team compared two extreme scenarios in product ranking design. The first involved personalised rankings, where algorithms use detailed consumer data to predict and prioritise products according to expected utility for each individual. The second employed unpersonalised rankings, where products are ordered based on aggregate preferences without tailoring to any specific user. These systems are standard in digital marketplaces such as Amazon and Expedia, which serve as search intermediaries, helping consumers navigate a growing sea of third-party listings. By focusing on these two ranking types, the researchers could isolate the effects of personalisation on pricing outcomes.

Central to the study was a consumer search model in which users examine product listings sequentially, incurring a small cost with each viewed item. Consumers are assumed to behave optimally—searching until the expected utility gain no longer outweighs the cost of continuing. The ranking system, therefore, plays a pivotal role in determining the order in which products are considered. In this framework, the researchers explored how reinforcement learning (RL) algorithms, often employed for pricing decisions, adapt to these ranking conditions. The assumption is that if a ranking system consistently pushes high-utility (and potentially high-priced) products to the top, pricing algorithms will learn they can raise prices without significantly dampening demand.

Indeed, the study found that personalised ranking systems tended to diminish the price sensitivity of consumer demand. When products most aligned with an individual’s preferences appear at the top of a list, the consumer is likelier to purchase them without continuing the search. This reduces the pressure on firms to maintain competitive pricing. As a result, AI pricing algorithms operating in such an environment learn that they can charge higher prices while still achieving strong sales performance. The reduced price elasticity leads to a general upward shift in pricing, even though no explicit collusion or discriminatory pricing occurs. Conversely, unpersonalised ranking systems, which do not cater specifically to individual preferences, maintain higher search incentives and encourage broader price comparison, leading to lower overall prices and greater consumer welfare.

Their consistency across multiple experimental conditions strengthens the credibility of these findings. The researchers tested various reinforcement learning algorithm types, adjusted learning parameters, included different valuations of outside options, and simulated scenarios involving several competing firms. Across all configurations, the core outcome remained the same: personalised rankings enabled higher prices and reduced consumer welfare, while unpersonalised rankings resulted in more competitive pricing. Liying Qiu, a doctoral student who led the study, highlighted the challenge of modelling these interactions due to the complexity of dynamic learning behaviours. Nevertheless, by constructing a controlled and replicable simulation environment, the team could empirically observe how AI pricing algorithms evolve in response to different ranking inputs.

These findings have significant implications for policymakers, platform designers, and regulators. The study underscores that ranking systems, which may appear neutral or beneficial at first glance, play an active role in shaping market outcomes. Personalisation, while helpful in reducing consumer search costs, can be weaponised by algorithms optimising for profit rather than consumer welfare. Focusing solely on price transparency or algorithmic fairness in isolation is not enough. Regulators must also consider how platform design choices—particularly product visibility and ranking—interact with pricing algorithms to affect competitive dynamics. The study suggests that limiting personalisation, or at least making its influence more transparent, may be necessary to safeguard consumer interests.

Finally, the research prompts a re-examination of the widespread belief that greater data sharing by consumers leads to improved market efficiency. While more data can improve product matching, it allows firms to tailor experiences in ways that ultimately erode consumer surplus subtly. Even without overt price discrimination, the information asymmetry introduced by personalisation can empower algorithms to manipulate demand patterns. As Professor Kannan Srinivasan, another co-author of the study, points out, the value of personalisation must be weighed carefully against its broader systemic effects. This study provides a cautionary roadmap for aligning technological advancement with public interest and competitive fairness for digital marketplaces increasingly reliant on AI and personal data.

More information: Liying Qiu et al, Personalization, Consumer Search, and Algorithmic Pricing, Marketing Science. DOI: 10.1287/mksc.2023.0455

Journal information: Marketing Science Provided by Carnegie Mellon University

Deciding Between Human and Algorithmic Decision-Makers

In contemporary society, algorithms have permeated various sectors, significantly impacting decision-making processes in critical areas such as criminal justice, healthcare, and finance. This growing reliance on algorithmic decision-making, however, has not been without controversy. Critics argue that it institutionalizes biases and compromises the principles of fairness. These concerns are not unfounded, given the opaque nature of some algorithms and the data on which they are trained.

To explore public perception and acceptance of algorithmic versus human decision-makers in high-stakes situations, researchers Kirk Bansak and Elisabeth Paulson conducted an extensive pre-registered study involving 9,000 participants from the United States. This study specifically focused on two scenarios: pretrial release and bank loan applications, both contexts where decision-making can have profound implications on individuals’ lives.

Participants in the study were divided into three groups. Each group was asked to choose between different pairs of decision-makers: one between two human decision-makers, another between two algorithmic decision-makers, and the third between one human and one algorithmic decision-maker. To inform their decisions, participants were provided with simulated statistics detailing the decision-makers’ past performance in terms of efficiency and fairness.

The study’s results revealed a notable trend: across all groups, participants showed a predominant preference for efficiency over fairness. This pattern held true regardless of the decision-makers’ nature—whether algorithmic or human. The inclination towards efficiency was consistent across diverse demographic lines, including race, political affiliation, education level, and personal beliefs about artificial intelligence. These findings suggest a broad, underlying preference that transcends individual demographic differences.

However, it is interesting to note that there was a slight but significant overall preference for human decision-makers over algorithms. This preference was more marked among Republicans than Democrats, highlighting a potential ideological divide in trust or scepticism towards algorithmic decision-making.

A paradox emerged when participants were asked about their values: a large majority claimed that fairness was their top priority. Yet, this priority did not significantly influence their choices, which predominantly favoured efficiency. This discrepancy raises questions about the cognitive dissonance between expressed values and actual decision-making behaviour.

Bansak and Paulson suggest that these findings have broader implications for adopting algorithmic decision-making systems across different sectors. They hypothesize that as algorithms become demonstrably more efficient, they are likely to gain wider acceptance, potentially overcoming existing cultural and psychological barriers. According to the authors, for algorithms to be embraced by all groups, their efficiency must be proven and clearly communicated and understood by the public.

The study highlights the complex dynamics of accepting algorithmic versus human decision-makers. It underscores the need for ongoing research to understand the factors influencing public trust in these systems. As algorithms evolve and become more integrated into critical decision-making processes, it will be crucial to address these challenges and ensure that they are employed to uphold the principles of fairness and transparency.

More information: Kirk Bansak et al, Public attitudes on performance for algorithmic and human decision-makers, PNAS Nexus. DOI: 10.1093/pnasnexus/pgae520

Journal information: PNAS Nexus

Enhanced Methodology Empowers AI in Detecting Human Deception

A team of researchers has introduced a novel training tool designed to enhance artificial intelligence (AI) ‘s capabilities in recognising when humans provide deceptive information, particularly in scenarios involving economic incentives. The tool addresses a critical issue where individuals may falsify personal data, such as when applying for mortgages or seeking to lower insurance premiums.

As Mehmet Caner, co-author of the study and Thurman-Raytheon Distinguished Professor of Economics at North Carolina State University’s Poole College of Management, points out, AI systems are extensively used in business applications, such as assessing mortgage affordability and determining insurance premiums. These systems, which traditionally rely on statistical algorithms for predictive modelling, inadvertently create a space for individuals to manipulate information to their advantage, leading to the need for the development of more sophisticated AI tools.

The research aimed to adjust AI algorithms to better accommodate these economic incentives for deception. By developing a new framework of training parameters, the researchers enabled AI to adapt its learning process to identify situations where users may have motives to lie. This enhancement focuses on improving AI’s ability to anticipate and account for human behaviour influenced by economic incentives.

In simulated trials, the modified AI demonstrated improved accuracy in detecting inaccuracies in user-provided data. “This effectively reduces the incentive for users to provide misleading information,” Caner explains. Nevertheless, the study acknowledges the challenge of distinguishing between minor falsehoods and more significant deceptions, prompting further investigation into establishing clear thresholds.

The team is now making these cutting-edge training parameters available to the public, with a strong call to AI developers worldwide to embrace and refine their applications. Caner underscores that this advancement is a significant stride towards curbing the economic motivations for dishonesty in AI-interpreted contexts. The ultimate aim is to elevate AI systems to a level where they can potentially eliminate such incentives, thereby fostering greater trust and reliability in automated decision-making processes.

More information: Mehmet Caner et al, Should Humans Lie to Machines? The Incentive Compatibility of Lasso and GLM Structured Sparsity Estimators, Journal of Business and Economic Statistics. DOI: 10.1080/07350015.2024.2316102

Journal information: Journal of Business and Economic Statistics Provided by North Carolina State University