title: On existence, uniqueness and scalability of adversarial robustness measures for AI classifiers

abstract: Simply-verifiable mathematical conditions for existence, uniqueness and explicit analytical computation of minimal adversarial paths (MAP) and minimal adversarial distances (MAD) for (locally) uniquely-invertible classifiers, for generalized linear models (GLM), and for entropic AI (EAI) are formulated and proven. Practical computation of MAP and MAD, their comparison and interpretations for various classes of AI tools (for neuronal networks, boosted random forests, GLM and EAI) are demonstrated on the common synthetic benchmarks: on a double Swiss roll spiral and its extensions, as well as on the two biomedical data problems (for the health insurance claim predictions, and for the heart attack lethality classification). On biomedical applications it is demonstrated how MAP provides unique minimal patient-specific risk-mitigating interventions in the predefined subsets of accessible control variables.


title: Large Language Models are biased to overestimate profoundness

abstract: Recent advancements in natural language processing by large language models (LLMs), such as GPT-4, have been suggested to approach Artificial General Intelligence. And yet, it is still under dispute whether LLMs possess similar reasoning abilities to humans. This study evaluates GPT-4 and various other LLMs in judging the profoundness of mundane, motivational, and pseudo-profound statements. We found a significant statement-to-statement correlation between the LLMs and humans, irrespective of the type of statements and the prompting technique used. However, LLMs systematically overestimate the profoundness of nonsensical statements, with the exception of Tk-instruct, which uniquely underestimates the profoundness of statements. Only few-shot learning prompts, as opposed to chain-of-thought prompting, draw LLMs ratings closer to humans. Furthermore, this work provides insights into the potential biases induced by Reinforcement Learning from Human Feedback (RLHF), inducing an increase in the bias to overestimate the profoundness of statements.


title: A Quadratic Synchronization Rule for Distributed Deep Learning

abstract: In distributed deep learning with data parallelism, synchronizing gradients at each training step can cause a huge communication overhead, especially when many nodes work together to train large models. Local gradient methods, such as Local SGD, address this issue by allowing workers to compute locally for $H$ steps without synchronizing with others, hence reducing communication frequency. While $H$ has been viewed as a hyperparameter to trade optimization efficiency for communication cost, recent research indicates that setting a proper $H$ value can lead to generalization improvement. Yet, selecting a proper $H$ is elusive. This work proposes a theory-grounded method for determining $H$, named the Quadratic Synchronization Rule (QSR), which recommends dynamically setting $H$ in proportion to $\frac{1}{\eta^2}$ as the learning rate $\eta$ decays over time. Extensive ImageNet experiments on ResNet and ViT show that local gradient methods with QSR consistently improve the test accuracy over other synchronization strategies. Compared with the standard data parallel training, QSR enables Local AdamW on ViT-B to cut the training time on 16 or 64 GPUs down from 26.7 to 20.2 hours or from 8.6 to 5.5 hours and, at the same time, achieves $1.16\%$ or $0.84\%$ higher top-1 validation accuracy.


title: Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluation

abstract: Human evaluation is increasingly critical for assessing large language models, capturing linguistic nuances, and reflecting user preferences more accurately than traditional automated metrics. However, the resource-intensive nature of this type of annotation process poses significant challenges. The key question driving our work: "is it feasible to minimize human-in-the-loop feedback by prioritizing data instances which most effectively distinguish between models?" We evaluate several metric-based methods and find that these metrics enhance the efficiency of human evaluations by minimizing the number of required annotations, thus saving time and cost, while ensuring a robust performance evaluation. We show that our method is effective across widely used model families, reducing instances of indecisive (or "tie") outcomes by up to 54% compared to a random sample when focusing on the top-20 percentile of prioritized instances. This potential reduction in required human effort positions our approach as a valuable strategy in future large language model evaluations.


title: Reformulation of the stable Adams conjecture

abstract: We revisit methods of proof of the Adams Conjecture in order to correct and supplement earlier efforts to prove analogous conjectures in the stable homotopy category. We utilize simplicial schemes over an algebraically closed field of positive characteristic and a rigid version of Artin-Mazur \'etale homotopy theory. Consideration of special $\mathcal F$-spaces and together with Bousfield-Kan $\mathbb Z/\ell$-completion enables us to employ an "\'etale functor" which commutes up to homotopy with products of simplicial schemes. In order to prove the Stable Adams Conjecture, we construct the universal $\mathbb Z/\ell$-completed $X$-fibrations for various pointed simplicial sets $X$. Thus, two maps from a given $\mathcal F$-space $\underline{\mathcal B}$ to the base $\mathcal F$-space of the universal $\mathbb Z/\ell$-completed $X$-fibration $\pi_{X,\ell}: \underline {\mathcal B} (G_\ell(X),X_\ell) \to \underline {\mathcal B} G_\ell(X)$ determine homotopy equivalent maps of spectra if and only they correspond via pull-back of $\pi_{X,\ell}$ to fiber homotopy equivalent $\mathbb Z/\ell$-completed $X$-fibrations over $\underline {\mathcal B}$. For the proof of the Stable Adams Conjecture, we consider maps of $\mathcal F$-spaces $\underline {\mathcal B }\to \underline {\mathcal B} G_\ell(S^2)$ where $\underline {\mathcal B}$ is an $\mathcal F$-space model of connective $\ell$-completed connective $K$-theory.


title: The third positive element in the greedy $B_h$-set

abstract: For $h \geq 1$, a $B_h$-set is a set of integers such that every integer $n$ has at most one representation in the form $n = a_{i_1} + \cdots + a_{i_h}$, where $a_{i_j} \in A$ for all $j = 1,\ldots, h$ and $a_{i_1} \leq \ldots \leq a_{i_h}$. The greedy $B_h$-set is the infinite set of nonnegative integers $\{a_0(h), a_1(h), a_2(h), \ldots \}$ constructed as follows: If $a_0(h) = 0$ and $\{a_0(h), a_1(h), a_2(h), \ldots, a_k(h) \}$ is a $B_h$-set, then $a_{k+1}(h)$ is the least positive integer such that $\{a_0(h), a_1(h), a_2(h), \ldots, a_k(h), a_{k+1}(h) \}$ is a $B_h$ set. One has $a_1(h) = 1$ and $a_2(h) = h+1$ for all $h$. Elementary proofs are given that $a_3(h) = h^2+h+1$ for all $h \geq 1$ and that $a_k(h) \leq \sum_{i=0}^{k-1} h^i$ for all $h \geq 1$ and $k \geq 1$.


title: CMDA: a tool for Continuous Monitoring Data Analysis

abstract: Over the last few years, with the growth of time-series collecting and storing, there has been a great demand for tools and software for temporal data engineering and modeling. This paper presents a generic workflow for time series data research, including temporal data importing, preprocessing, and feature extraction. This framework is developed and built as a robust and easy-to-use Python package, called CMDA, with a modular structure that offers tools to prepare raw data, allowing both scientists and non-experts to analyze various temporal data structures.


title: Explicit bounds on the coefficients of the modular polynomials and the size of $X_0(N)$

abstract: We give explicit upper and lower bounds on the size of the coefficients of the modular polynomials $\Phi_N$ for the elliptic $j$-function. These bounds make explicit the best previously known asymptotic bounds. We then give an explicit version of Silverman's Hecke points estimates. Finally, we give an asymptotic comparison between the Faltings height of the modular curve $X_0(N)$ and the height of the modular polynomial $\Phi_N$.


title: Text generation for dataset augmentation in security classification tasks

abstract: Security classifiers, designed to detect malicious content in computer systems and communications, can underperform when provided with insufficient training data. In the security domain, it is often easy to find samples of the negative (benign) class, and challenging to find enough samples of the positive (malicious) class to train an effective classifier. This study evaluates the application of natural language text generators to fill this data gap in multiple security-related text classification tasks. We describe a variety of previously-unexamined language-model fine-tuning approaches for this purpose and consider in particular the impact of disproportionate class-imbalances in the training set. Across our evaluation using three state-of-the-art classifiers designed for offensive language detection, review fraud detection, and SMS spam detection, we find that models trained with GPT-3 data augmentation strategies outperform both models trained without augmentation and models trained using basic data augmentation strategies already in common usage. In particular, we find substantial benefits for GPT-3 data augmentation strategies in situations with severe limitations on known positive-class samples.


title: Clustering Students Based on Gamification User Types and Learning Styles

abstract: The aim of this study is clustering students according to their gamification user types and learning styles with the purpose of providing instructors with a new perspective of grouping students in case of clustering which cannot be done by hand when there are multiple scales in data. The data used consists of 251 students who were enrolled at a Turkish state university. When grouping students, K-means algorithm has been utilized as clustering algorithm. As for determining the gamification user types and learning styles of students, Gamification User Type Hexad Scale and Grasha-Riechmann Student Learning Style Scale have been used respectively. Silhouette coefficient is utilized as clustering quality measure. After fitting the algorithm in several ways, highest Silhouette coefficient obtained was 0.12 meaning that results are neutral but not satisfactory. All the statistical operations and data visualizations were made using Python programming language.


title: Gamma-ray detection of newly discovered Ancora SNR: G288.8-6.3

abstract: The supernova remnant (SNR) G288.8-6.3 was recently discovered as a faint radio shell at large Galactic latitude using observations with ASKAP in the EMU survey. Here, we make the first detailed investigation of the $\gamma$-ray emission from the G288.8-6.3 region, aiming to characterise the high-energy emission in the GeV regime from the newly discovered SNR, dubbed Ancora. 15 years of Fermi-Large Area Telescope (LAT) data were analysed at energies between 400 MeV and 1 TeV and the excess seen in the region was modelled using different spatial and spectral models. We detect spatially extended $\gamma$-ray emission coinciding with the radio SNR, with detection significance up to 8.8 $\sigma$. A radial disk spatial model in combination with a power-law spectral model with an energy flux of $(4.80 \pm 0.91) \times 10^{-6}$ $\text{MeV}$ $\text{cm}^{-2}$ $\text{s}^{-1}$, with the spectrum extending up to around 5 GeV was found to be the preferred model. Morphologically, hotspots seen above 1 GeV are well-correlated with the bright western part of the radio shell. The emission is more likely to be of leptonic origin given the estimated gas density in the region and the estimated distance and age of the SNR, but a hadronic scenario cannot be ruled out. Ancora is the eighth SNR detected at high Galactic latitude with Fermi-LAT. This new population of remnants has the potential to constrain the physics of particle diffusion and escape from SNRs into the Galaxy.


title: Fairness-aware Optimal Graph Filter Design

abstract: Graphs are mathematical tools that can be used to represent complex real-world interconnected systems, such as financial markets and social networks. Hence, machine learning (ML) over graphs has attracted significant attention recently. However, it has been demonstrated that ML over graphs amplifies the already existing bias towards certain under-represented groups in various decision-making problems due to the information aggregation over biased graph structures. Faced with this challenge, here we take a fresh look at the problem of bias mitigation in graph-based learning by borrowing insights from graph signal processing. Our idea is to introduce predesigned graph filters within an ML pipeline to reduce a novel unsupervised bias measure, namely the correlation between sensitive attributes and the underlying graph connectivity. We show that the optimal design of said filters can be cast as a convex problem in the graph spectral domain. We also formulate a linear programming (LP) problem informed by a theoretical bias analysis, which attains a closed-form solution and leads to a more efficient fairness-aware graph filter. Finally, for a design whose degrees of freedom are independent of the input graph size, we minimize the bias metric over the family of polynomial graph convolutional filters. Our optimal filter designs offer complementary strengths to explore favorable fairness-utility-complexity tradeoffs. For performance evaluation, we conduct extensive and reproducible node classification experiments over real-world networks. Our results show that the proposed framework leads to better fairness measures together with similar utility compared to state-of-the-art fairness-aware baselines.


title: Investigate how developers and managers view security design in software

abstract: Software security requirements have been traditionally considered as a non-functional attribute of the software. However, as more software started to provide services online, existing mechanisms of using firewalls and other hardware to secure software have lost their applicability. At the same time, under the current world circumstances, the increase of cyber-attacks on software is ever increasing. As a result, it is important to consider the security requirements of software during its design. To design security in the software, it is important to obtain the views of the developers and managers of the software. Also, it is important to evaluate if their viewpoints match or differ regarding the security. Conducting this communication through a specific model will enable the developers and managers to eliminate any doubts on security design and adopt an effective strategy to build security into the software. In this paper, we analyzed the viewpoints of developers and managers regarding their views on security design. We interviewed a team of 7 developers and 2 managers, who worked in two teams to build a real-life software product that was recently compromised by a cyber-attack. We obtained their views on the reasons for the successful attack by the malware and took their recommendations on the important aspects to consider regarding security. Based on their feedback, we coded their open-ended responses into 4 codes, which we recommended using for other real-life software as well.


title: Enhancing Accuracy-Privacy Trade-off in Differentially Private Split Learning

abstract: Split learning (SL) aims to protect user data privacy by distributing deep models between client-server and keeping private data locally. Only processed or `smashed' data can be transmitted from the clients to the server during the SL process. However, recently proposed model inversion attacks can recover the original data from the smashed data. In order to enhance privacy protection against such attacks, a strategy is to adopt differential privacy (DP), which involves safeguarding the smashed data at the expense of some accuracy loss. This paper presents the first investigation into the impact on accuracy when training multiple clients in SL with various privacy requirements. Subsequently, we propose an approach that reviews the DP noise distributions of other clients during client training to address the identified accuracy degradation. We also examine the application of DP to the local model of SL to gain insights into the trade-off between accuracy and privacy. Specifically, findings reveal that introducing noise in the later local layers offers the most favorable balance between accuracy and privacy. Drawing from our insights in the shallower layers, we propose an approach to reduce the size of smashed data to minimize data leakage while maintaining higher accuracy, optimizing the accuracy-privacy trade-off. Additionally, a smaller size of smashed data reduces communication overhead on the client side, mitigating one of the notable drawbacks of SL. Experiments with popular datasets demonstrate that our proposed approaches provide an optimal trade-off for incorporating DP into SL, ultimately enhancing training accuracy for multi-client SL with varying privacy requirements.


title: Retrieval-Augmented Chain-of-Thought in Semi-structured Domains

abstract: Applying existing question answering (QA) systems to specialized domains like law and finance presents challenges that necessitate domain expertise. Although large language models (LLMs) have shown impressive language comprehension and in-context learning capabilities, their inability to handle very long inputs/contexts is well known. Tasks specific to these domains need significant background knowledge, leading to contexts that can often exceed the maximum length that existing LLMs can process. This study explores leveraging the semi-structured nature of legal and financial data to efficiently retrieve relevant context, enabling the use of LLMs for domain-specialized QA. The resulting system outperforms contemporary models and also provides useful explanations for the answers, encouraging the integration of LLMs into legal and financial NLP systems for future research.


title: Construction of a Dirichlet form on metric measure spaces of controlled geometry

abstract: Given a compact doubling metric measure space $X$ that supports a $2$-Poincar\'e inequality, we construct a Dirichlet form on $N^{1,2}(X)$ that is comparable to the upper gradient energy form on $N^{1,2}(X)$. Our approach is based on the approximation of $X$ by a family of graphs that is doubling and supports a $2$-Poincar\'e inequality. We construct a bilinear form on $N^{1,2}(X)$ using the Dirichlet form on the graph. We show that the $\Gamma$-limit $\mathcal{E}$ of this family of bilinear forms (by taking a subsequence) exists and that $\mathcal{E}$ is a Dirichlet form on $X$. Properties of $\mathcal{E}$ are established. Moreover, we prove that $\mathcal{E}$ has the property of matching boundary values on a domain $\Omega\subseteq X$. This construction makes it possible to approximate harmonic functions (with respect to the Dirichlet form $\mathcal{E}$) on a domain in $X$ with a prescribed Lipschitz boundary data via a numerical scheme dictated by the approximating Dirichlet forms, which are discrete objects.


title: Mobile AR Depth Estimation: Challenges & Prospects -- Extended Version

abstract: Metric depth estimation plays an important role in mobile augmented reality (AR). With accurate metric depth, we can achieve more realistic user interactions such as object placement and occlusion detection. While specialized hardware like LiDAR demonstrates its promise, its restricted availability, i.e., only on selected high-end mobile devices, and performance limitations such as range and sensitivity to the environment, make it less ideal. Monocular depth estimation, on the other hand, relies solely on mobile cameras, which are ubiquitous, making it a promising alternative for mobile AR. In this paper, we investigate the challenges and opportunities of achieving accurate metric depth estimation in mobile AR. We tested four different state-of-the-art monocular depth estimation models on a newly introduced dataset (ARKitScenes) and identified three types of challenges: hard-ware, data, and model related challenges. Furthermore, our research provides promising future directions to explore and solve those challenges. These directions include (i) using more hardware-related information from the mobile device's camera and other available sensors, (ii) capturing high-quality data to reflect real-world AR scenarios, and (iii) designing a model architecture to utilize the new information.


title: BVARs and Stochastic Volatility

abstract: Bayesian vector autoregressions (BVARs) are the workhorse in macroeconomic forecasting. Research in the last decade has established the importance of allowing time-varying volatility to capture both secular and cyclical variations in macroeconomic uncertainty. This recognition, together with the growing availability of large datasets, has propelled a surge in recent research in building stochastic volatility models suitable for large BVARs. Some of these new models are also equipped with additional features that are especially desirable for large systems, such as order invariance -- i.e., estimates are not dependent on how the variables are ordered in the BVAR -- and robustness against COVID-19 outliers. Estimation of these large, flexible models is made possible by the recently developed equation-by-equation approach that drastically reduces the computational cost of estimating large systems. Despite these recent advances, there remains much ongoing work, such as the development of parsimonious approaches for time-varying coefficients and other types of nonlinearities in large BVARs.


title: Towards the automation of book typesetting

abstract: This paper proposes a generative approach for the automatic typesetting of books in desktop publishing. The presented system consists in a computer script that operates inside a widely used design software tool and implements a generative process based on several typographic rules, styles and principles which have been identified in the literature. The performance of the proposed system is tested through an experiment which included the evaluation of its outputs with people. The results reveal the ability of the system to consistently create varied book designs from the same input content as well as visually coherent book designs with different contents while complying with fundamental typographic principles.


title: On explicit soliton solutions and blow-up for coupled variable coefficient nonlinear Schr\"{o}dinger equations

abstract: This work is concerned with the study of explicit solutions for a generalized coupled nonlinear Schr\"{o}dinger equations (NLS) system with variable coefficients. Indeed, we show, employing similarity transformations, the existence of Rogue wave and dark-bright soliton like-solutions for such a generalized NLS system, provided the coefficients satisfy a Riccati system. As a result of the multiparameter solution of the Riccati system, the nonlinear dynamics of the solution can be controlled. Finite-time singular solutions in the $L^{\infty}$ norm for the generalized coupled NLS system are presented explicitly. Finally, an n-dimensional transformation between a variable coefficient NLS coupled system and a constant coupled system coefficient is presented. Soliton and Rogue wave solutions for this high-dimensional system are presented as well. A Mathematica file has been prepared as supplementary material, verifying the Riccati systems used in the construction of the solutions.


title: EDGE++: Improved Training and Sampling of EDGE

abstract: Recently developed deep neural models like NetGAN, CELL, and Variational Graph Autoencoders have made progress but face limitations in replicating key graph statistics on generating large graphs. Diffusion-based methods have emerged as promising alternatives, however, most of them present challenges in computational efficiency and generative performance. EDGE is effective at modeling large networks, but its current denoising approach can be inefficient, often leading to wasted computational resources and potential mismatches in its generation process. In this paper, we propose enhancements to the EDGE model to address these issues. Specifically, we introduce a degree-specific noise schedule that optimizes the number of active nodes at each timestep, significantly reducing memory consumption. Additionally, we present an improved sampling scheme that fine-tunes the generative process, allowing for better control over the similarity between the synthesized and the true network. Our experimental results demonstrate that the proposed modifications not only improve the efficiency but also enhance the accuracy of the generated graphs, offering a robust and scalable solution for graph generation tasks.


title: Diversity Preferences, Affirmative Action and Choice Rules

abstract: I study the relationship between diversity preferences and the choice rules implemented by institutions, with a particular focus on the affirmative action policies. I characterize the choice rules that can be rationalized by diversity preferences and demonstrate that the recently rescinded affirmative action mechanism used to allocate government positions in India cannot be rationalized. I show that if institutions evaluate diversity without considering intersectionality of identities, their choices cannot satisfy the crucial substitutes condition. I characterize choice rules that satisfy the substitutes condition and are rationalizable by preferences that are separable in diversity and match quality domains.


title: Submodular Optimization for Placement of Intelligent Reflecting Surfaces in Sensing Systems

abstract: Intelligent reflecting surfaces (IRS) and their optimal deployment are the new technological frontier in sensing applications. Recently, IRS have demonstrated potential in advancing target estimation and detection. While the optimal phase-shift of IRS for different tasks has been studied extensively in the literature, the optimal placement of multiple IRS platforms for sensing applications is less explored. In this paper, we design the placement of IRS platforms for sensing by maximizing the mutual information. In particular, we use this criterion to determine an approximately optimal placement of IRS platforms to illuminate an area where the target has a hypothetical presence. After demonstrating the submodularity of the mutual information criteria, we tackle the design problem by means of a constant-factor approximation algorithm for submodular optimization. Numerical results are presented to validate the proposed submodular optimization framework for optimal IRS placement with worst case performance bounded to $1-1/e\approx 63 \%$.


title: URegM: a unified prediction model of resource consumption for refactoring software smells in open source cloud

abstract: The low cost and rapid provisioning capabilities have made the cloud a desirable platform to launch complex scientific applications. However, resource utilization optimization is a significant challenge for cloud service providers, since the earlier focus is provided on optimizing resources for the applications that run on the cloud, with a low emphasis being provided on optimizing resource utilization of the cloud computing internal processes. Code refactoring has been associated with improving the maintenance and understanding of software code. However, analyzing the impact of the refactoring source code of the cloud and studying its impact on cloud resource usage require further analysis. In this paper, we propose a framework called Unified Regression Modelling (URegM) which predicts the impact of code smell refactoring on cloud resource usage. We test our experiments in a real-life cloud environment using a complex scientific application as a workload. Results show that URegM is capable of accurately predicting resource consumption due to code smell refactoring. This will permit cloud service providers with advanced knowledge about the impact of refactoring code smells on resource consumption, thus allowing them to plan their resource provisioning and code refactoring more effectively.


title: On the arboricity of manifolds

abstract: The arboricity of a discrete 2-sphere is always 3. The arboricity of any other discrete 2-dimensional surface is always 4. For d-manifolds of dimension larger than 2, the arboricity can be arbitrary large and must be larger than d.


title: A Viscosity Solution Theory of Stochastic Hamilton-Jacobi-Bellman equations in the Wasserstein Space

abstract: This paper is devoted to a viscosity solution theory of the stochastic Hamilton-Jacobi-Bellman equation in the Wasserstein spaces for the mean-field type control problem which allows for random coefficients and may thus be non-Markovian. The value function of the control problem is proven to be the unique viscosity solution. The major challenge lies in the mixture of the lack of local compactness of the Wasserstein spaces and the non-Markovian setting with random coefficients and various techniques are used, including Ito processes parameterized by random measures, the conditional law invariance of the value function, a novel tailor-made compact subset of measure-valued processes, finite dimensional approximations via stochastic n-player differential games with common noises, and so on.


title: SOUL at LBT: commissioning results, science and future

abstract: The SOUL systems at the Large Bincoular Telescope can be seen such as precursor for the ELT SCAO systems, combining together key technologies such as EMCCD, Pyramid WFS and adaptive telescopes. After the first light of the first upgraded system on September 2018, going through COVID and technical stops, we now have all the 4 systems working on-sky. Here, we report about some key control improvements and the system performance characterized during the commissioning. The upgrade allows us to correct more modes (500) in the bright end and increases the sky coverage providing SR(K)>20% with reference stars G$_{RP}$<17, opening to extragalcatic targets with NGS systems. Finally, we review the first astrophysical results, looking forward to the next generation instruments (SHARK-NIR, SHARK-Vis and iLocater), to be fed by the SOUL AO correction.


title: Semiparametrically Efficient Score for the Survival Odds Ratio

abstract: We consider a general proportional odds model for survival data under binary treatment, where the functional form of the covariates is left unspecified. We derive the efficient score for the conditional survival odds ratio given the covariates using modern semiparametric theory. The efficient score may be useful in the development of doubly robust estimators, although computational challenges remain.


title: Qualitative analysis of the relationship between design smells and software engineering challenges

abstract: Software design debt aims to elucidate the rectification attempts of the present design flaws and studies the influence of those to the cost and time of the software. Design smells are a key cause of incurring design debt. Although the impact of design smells on design debt have been predominantly considered in current literature, how design smells are caused due to not following software engineering best practices require more exploration. This research provides a tool which is used for design smell detection in Java software by analyzing large volume of source codes. More specifically, 409,539 Lines of Code (LoC) and 17,760 class files of open source Java software are analyzed here. Obtained results show desirable precision values ranging from 81.01\% to 93.43\%. Based on the output of the tool, a study is conducted to relate the cause of the detected design smells to two software engineering challenges namely "irregular team meetings" and "scope creep". As a result, the gained information will provide insight to the software engineers to take necessary steps of design remediation actions.


title: TATA: Stance Detection via Topic-Agnostic and Topic-Aware Embeddings

abstract: Stance detection is important for understanding different attitudes and beliefs on the Internet. However, given that a passage's stance toward a given topic is often highly dependent on that topic, building a stance detection model that generalizes to unseen topics is difficult. In this work, we propose using contrastive learning as well as an unlabeled dataset of news articles that cover a variety of different topics to train topic-agnostic/TAG and topic-aware/TAW embeddings for use in downstream stance detection. Combining these embeddings in our full TATA model, we achieve state-of-the-art performance across several public stance detection datasets (0.771 $F_1$-score on the Zero-shot VAST dataset). We release our code and data at https://github.com/hanshanley/tata.


title: Domain Terminology Integration into Machine Translation: Leveraging Large Language Models

abstract: This paper discusses the methods that we used for our submissions to the WMT 2023 Terminology Shared Task for German-to-English (DE-EN), English-to-Czech (EN-CS), and Chinese-to-English (ZH-EN) language pairs. The task aims to advance machine translation (MT) by challenging participants to develop systems that accurately translate technical terms, ultimately enhancing communication and understanding in specialised domains. To this end, we conduct experiments that utilise large language models (LLMs) for two purposes: generating synthetic bilingual terminology-based data, and post-editing translations generated by an MT model through incorporating pre-approved terms. Our system employs a four-step process: (i) using an LLM to generate bilingual synthetic data based on the provided terminology, (ii) fine-tuning a generic encoder-decoder MT model, with a mix of the terminology-based synthetic data generated in the first step and a randomly sampled portion of the original generic training data, (iii) generating translations with the fine-tuned MT model, and (iv) finally, leveraging an LLM for terminology-constrained automatic post-editing of the translations that do not include the required terms. The results demonstrate the effectiveness of our proposed approach in improving the integration of pre-approved terms into translations. The number of terms incorporated into the translations of the blind dataset increases from an average of 36.67% with the generic model to an average of 72.88% by the end of the process. In other words, successful utilisation of terms nearly doubles across the three language pairs.


title: Polyharmonic hypersurfaces into complex space forms

abstract: We characterize homogeneous hypersurfaces in complex space forms which arise as critical points of a higher order energy functional. As a consequence, we obtain existence and non-existence results for $\mathbb{CP}^n$ and $\mathbb{CH}^n$, respectively. Moreover, we study the stability of biharmonic hypersurfaces and compute the normal index for a large family of solutions.


title: Skipped Feature Pyramid Network with Grid Anchor for Object Detection

abstract: CNN-based object detection methods have achieved significant progress in recent years. The classic structures of CNNs produce pyramid-like feature maps due to the pooling or other re-scale operations. The feature maps in different levels of the feature pyramid are used to detect objects with different scales. For more accurate object detection, the highest-level feature, which has the lowest resolution and contains the strongest semantics, is up-scaled and connected with the lower-level features to enhance the semantics in the lower-level features. However, the classic mode of feature connection combines the feature of lower-level with all the features above it, which may result in semantics degradation. In this paper, we propose a skipped connection to obtain stronger semantics at each level of the feature pyramid. In our method, the lower-level feature only connects with the feature at the highest level, making it more reasonable that each level is responsible for detecting objects with fixed scales. In addition, we simplify the generation of anchor for bounding box regression, which can further improve the accuracy of object detection. The experiments on the MS COCO and Wider Face demonstrate that our method outperforms the state-of-the-art methods.


title: Tunneling between two systems of interacting chiral fermions

abstract: We develop a theory of tunneling between two systems of spinless chiral fermions. This setup can be realized at the edge of a quantum Hall bilayer structure. We find that the differential conductance of such a device in the absence of interactions has an infinitely sharp peak as a function of applied voltage. Interaction between fermions results in broadening of the conductance peak. We focus on the regime of strong interactions, in which the shape of the peak manifests well defined features associated with the elementary excitations of the system.


title: An International Consortium for Evaluations of Societal-Scale Risks from Advanced AI

abstract: Given rapid progress toward advanced AI and risks from frontier AI systems (advanced AI systems pushing the boundaries of the AI capabilities frontier), the creation and implementation of AI governance and regulatory schemes deserves prioritization and substantial investment. However, the status quo is untenable and, frankly, dangerous. A regulatory gap has permitted AI labs to conduct research, development, and deployment activities with minimal oversight. In response, frontier AI system evaluations have been proposed as a way of assessing risks from the development and deployment of frontier AI systems. Yet, the budding AI risk evaluation ecosystem faces significant coordination challenges, such as a limited diversity of evaluators, suboptimal allocation of effort, and perverse incentives. This paper proposes a solution in the form of an international consortium for AI risk evaluations, comprising both AI developers and third-party AI risk evaluators. Such a consortium could play a critical role in international efforts to mitigate societal-scale risks from advanced AI, including in managing responsible scaling policies and coordinated evaluation-based risk response. In this paper, we discuss the current evaluation ecosystem and its shortcomings, propose an international consortium for advanced AI risk evaluations, discuss issues regarding its implementation, discuss lessons that can be learnt from previous international institutions and existing proposals for international AI governance institutions, and, finally, we recommend concrete steps to advance the establishment of the proposed consortium: (i) solicit feedback from stakeholders, (ii) conduct additional research, (iii) conduct a workshop(s) for stakeholders, (iv) analyze feedback and create final proposal, (v) solicit funding, and (vi) create a consortium.


title: Mobile Traffic Prediction at the Edge through Distributed and Transfer Learning

abstract: Traffic prediction represents one of the crucial tasks for smartly optimizing the mobile network. The research in this topic concentrated in making predictions in a centralized fashion, i.e., by collecting data from the different network elements. This translates to a considerable amount of energy for data transmission and processing. In this work, we propose a novel prediction framework based on edge computing which uses datasets obtained on the edge through a large measurement campaign. Two main Deep Learning architectures are designed, based on Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), and tested under different training conditions. In addition, Knowledge Transfer Learning (KTL) techniques are employed to improve the performance of the models while reducing the required computational resources. Simulation results show that the CNN architectures outperform the RNNs. An estimation for the needed training energy is provided, highlighting KTL ability to reduce the energy footprint of the models of 60% and 90% for CNNs and RNNs, respectively. Finally, two cutting-edge explainable Artificial Intelligence techniques are employed to interpret the derived learning models.


title: A generalized likelihood-weighted optimal sampling algorithm for rare-event probability quantification

abstract: In this work, we introduce a new acquisition function for sequential sampling to efficiently quantify rare-event statistics of an input-to-response (ItR) system with given input probability and expensive function evaluations. Our acquisition is a generalization of the likelihood-weighted (LW) acquisition that was initially designed for the same purpose and then extended to many other applications. The improvement in our acquisition comes from the generalized form with two additional parameters, by varying which one can target and address two weaknesses of the original LW acquisition: (1) that the input space associated with rare-event responses is not sufficiently stressed in sampling; (2) that the surrogate model (generated from samples) may have significant deviation from the true ItR function, especially for cases with complex ItR function and limited number of samples. In addition, we develop a critical procedure in Monte-Carlo discrete optimization of the acquisition function, which achieves orders of magnitude acceleration compared to existing approaches for such type of problems. The superior performance of our new acquisition to the original LW acquisition is demonstrated in a number of test cases, including some cases that were designed to show the effectiveness of the original LW acquisition. We finally apply our method to an engineering example to quantify the rare-event roll-motion statistics of a ship in a random sea.


title: Diffusion-Model-Assisted Supervised Learning of Generative Models for Density Estimation

abstract: We present a supervised learning framework of training generative models for density estimation. Generative models, including generative adversarial networks, normalizing flows, variational auto-encoders, are usually considered as unsupervised learning models, because labeled data are usually unavailable for training. Despite the success of the generative models, there are several issues with the unsupervised training, e.g., requirement of reversible architectures, vanishing gradients, and training instability. To enable supervised learning in generative models, we utilize the score-based diffusion model to generate labeled data. Unlike existing diffusion models that train neural networks to learn the score function, we develop a training-free score estimation method. This approach uses mini-batch-based Monte Carlo estimators to directly approximate the score function at any spatial-temporal location in solving an ordinary differential equation (ODE), corresponding to the reverse-time stochastic differential equation (SDE). This approach can offer both high accuracy and substantial time savings in neural network training. Once the labeled data are generated, we can train a simple fully connected neural network to learn the generative model in the supervised manner. Compared with existing normalizing flow models, our method does not require to use reversible neural networks and avoids the computation of the Jacobian matrix. Compared with existing diffusion models, our method does not need to solve the reverse-time SDE to generate new samples. As a result, the sampling efficiency is significantly improved. We demonstrate the performance of our method by applying it to a set of 2D datasets as well as real data from the UCI repository.


title: ANN-MoC Method for Inverse Transient Transport Problems in One-Dimensional Geometry

abstract: The inverse problems of particle neutral transport models have many important engineering and medical applications. Safety protocols, quality control procedures, and optical medical solutions can be developed based on inverse transport solutions. In this work, we propose the ANN-MoC method to solve the inverse transient transport problem of estimating the absorption coefficient from measurements of the scalar flux at the boundaries of the model domain. The main idea is to train an Artificial Neural Network (ANN) from data generated by direct solutions computed by a Method of Characteristics (MoC) solver. The direct solver is tested on a problem with a manufactured solution. And, the proposed ANN-MoC method is tested on two inverse problems. In the first, the medium is homogeneous and has a constant absorption coefficient. In the second, a heterogeneous medium is considered, with the absorption coefficient constant by parts. Very accurate ANN estimations have been achieved for these two problems, indicating that the quality of the results relies on the accuracy of the direct solver solutions. The results show the potential of the proposed approach to be applied to more realistic inverse transport problems.


title: Solar Magnetic Polarity Effect on Neutron Monitor Count Rates: Comparing Latitude Surveys and Antarctic Stations

abstract: The Galactic cosmic ray spectrum manifests pronounced variations over the 11-year sunspot cycle and more subtle variations over the 22-year solar magnetic cycle. An important tool to study these variations is repeated latitude surveys with neutron monitors (NMs) onboard icebreakers in conjunction with land-based references. We revisit 13 annual latitude surveys from 1994 to 2007 using reference data from the Mawson NM instead of McMurdo NM (which closed in 2017). We then consider two more latitude surveys (2018 and 2019) with a monitor similar to the 3NM64 in the previous surveys but without lead rings around the central tube, a so-called ``semi-leaded neutron monitor.'' The new surveys extend the linear relationship among data taken at different cutoff rigidity ranges. They also confirm the ``crossover'' measured near solar minima during epochs of opposite solar magnetic polarity and the absence of a crossover for epochs having the same solar magnetic polarity.


title: Experimental study on the principle of minimal work fluctuations

abstract: The central quantity in the celebrated quantum Jarzynski equality is $e^{-\beta W}$, where $W$ is work and $\beta$ is the inverse temperature. The impact of quantum randomness on the fluctuations of $e^{-\beta W}$ and hence on the predictive power of the Jarzynski estimator is an important problem. Working on a single nitrogen-vacancy center in diamond and riding on an implementation of two-point measurement of non-equilibrium work with single-shot readout, we have conducted a direct experimental investigation of the relationship between the fluctuations of $e^{-\beta W}$ and adiabaticity of non-equilibrium work protocols. It is observed that adiabatic processes minimize the variance of $e^{-\beta W}$, thus verifying an early theoretical concept, the so-called principle of minimal work fluctuations. Furthermore, it is experimentally demonstrated that shortcuts-to-adiabaticity control can be exploited to minimize the variance of $e^{-\beta W}$ in fast work protocols. Our work should stimulate further experimental studies of quantum effects on the bias and error in the estimates of free energy differences based on the Jarzynski equality.


title: Fast Fourier transform via automorphism groups of rational function fields

abstract: The Fast Fourier Transform (FFT) over a finite field $\mathbb{F}_q$ computes evaluations of a given polynomial of degree less than $n$ at a specifically chosen set of $n$ distinct evaluation points in $\mathbb{F}_q$. If $q$ or $q-1$ is a smooth number, then the divide-and-conquer approach leads to the fastest known FFT algorithms. Depending on the type of group that the set of evaluation points forms, these algorithms are classified as multiplicative (Math of Comp. 1965) and additive (FOCS 2014) FFT algorithms. In this work, we provide a unified framework for FFT algorithms that include both multiplicative and additive FFT algorithms as special cases, and beyond: our framework also works when $q+1$ is smooth, while all known results require $q$ or $q-1$ to be smooth. For the new case where $q+1$ is smooth (this new case was not considered before in literature as far as we know), we show that if $n$ is a divisor of $q+1$ that is $B$-smooth for a real $B>0$, then our FFT needs $O(Bn\log n)$ arithmetic operations in $\mathbb{F}_q$. Our unified framework is a natural consequence of introducing the algebraic function fields into the study of FFT.


title: Tightening QC Relaxations of AC Optimal Power Flow through Improved Linear Convex Envelopes

abstract: AC optimal power flow (AC OPF) is a fundamental problem in power system operations. Accurately modeling the network physics via the AC power flow equations makes AC OPF a challenging nonconvex problem. To search for global optima, recent research has developed a variety of convex relaxations that bound the optimal objective values of AC OPF problems. The well-known QC relaxation convexifies the AC OPF problem by enclosing the non-convex terms (trigonometric functions and products) within convex envelopes. The accuracy of this method strongly depends on the tightness of these envelopes. This paper proposes two improvements for tightening QC relaxations of OPF problems. We first consider a particular nonlinear function whose projections are the nonlinear expressions appearing in the polar representation of the power flow equations. We construct a convex envelope around this nonlinear function that takes the form of a polytope and then use projections of this envelope to obtain convex expressions for the nonlinear terms. Second, we use certain characteristics of the sine and cosine expressions along with the changes in their curvature to tighten this convex envelope. We also propose a coordinate transformation that rotates the power flow equations by an angle specific to each bus in order to obtain a tighter envelope. We demonstrate these improvements relative to a state-of-the-art QC relaxation implementation using the PGLib-OPF test cases. The results show improved optimality gaps in 68% of these cases.


title: A Cryptographic Perspective on the Verifiability of Quantum Advantage

abstract: In recent years, achieving verifiable quantum advantage on a NISQ device has emerged as an important open problem in quantum information. The sampling-based quantum advantages are not known to have efficient verification methods. This paper investigates the verification of quantum advantage from a cryptographic perspective. We establish a strong connection between the verifiability of quantum advantage and cryptographic and complexity primitives, including efficiently samplable, statistically far but computationally indistinguishable pairs of (mixed) quantum states ($\mathsf{EFI}$), pseudorandom states ($\mathsf{PRS}$), and variants of minimum circuit size problems ($\mathsf{MCSP}$). Specifically, we prove that a) a sampling-based quantum advantage is either verifiable or can be used to build $\mathsf{EFI}$ and even $\mathsf{PRS}$ and b) polynomial-time algorithms for a variant of $\mathsf{MCSP}$ would imply efficient verification of quantum advantages. Our work shows that the quest for verifiable quantum advantages may lead to applications of quantum cryptography, and the construction of quantum primitives can provide new insights into the verifiability of quantum advantages.


title: Channel State Information-Free Location-Privacy Enhancement: Delay-Angle Information Spoofing

abstract: In this paper, a delay-angle information spoofing (DAIS) strategy is proposed for location-privacy enhancement. By shifting the location-relevant delays and angles without the aid of channel state information (CSI) at the transmitter, the eavesdropper is obfuscated by a physical location that is distinct from the true one. A precoder is designed to preserve location-privacy while the legitimate localizer can remove the obfuscation with the securely shared information. Then, a lower bound on the localization error is derived via the analysis of the geometric mismatch caused by DAIS, validating the enhanced location-privacy. The statistical hardness for the estimation of the shared information is also investigated to assess the robustness to the potential leakage of the designed precoder structure. Numerical comparisons show that the proposed DAIS scheme results in more than 15 dB performance degradation for the illegitimate localizer at high signal-to-noise ratios, which is comparable to a recently proposed CSI-free location-privacy enhancement strategy and is less sensitive to the precoder structure leakage than the prior approach.


title: Inferring Relational Potentials in Interacting Systems

abstract: Systems consisting of interacting agents are prevalent in the world, ranging from dynamical systems in physics to complex biological networks. To build systems which can interact robustly in the real world, it is thus important to be able to infer the precise interactions governing such systems. Existing approaches typically discover such interactions by explicitly modeling the feed-forward dynamics of the trajectories. In this work, we propose Neural Interaction Inference with Potentials (NIIP) as an alternative approach to discover such interactions that enables greater flexibility in trajectory modeling: it discovers a set of relational potentials, represented as energy functions, which when minimized reconstruct the original trajectory. NIIP assigns low energy to the subset of trajectories which respect the relational constraints observed. We illustrate that with these representations NIIP displays unique capabilities in test-time. First, it allows trajectory manipulation, such as interchanging interaction types across separately trained models, as well as trajectory forecasting. Additionally, it allows adding external hand-crafted potentials at test-time. Finally, NIIP enables the detection of out-of-distribution samples and anomalies without explicit training. Website: https://energy-based-model.github.io/interaction-potentials.


title: Giant Magnetothermal Conductivity Switching in Semimetallic WSi$_{2}$ Single Crystals

abstract: Materials able to rapidly switch between thermally conductive states by external stimuli such as electric or magnetic fields can be used as all-solid-state thermal switches and open a myriad of applications in heat management, power generation and cooling. Here, we show that the large magnetoresistance that occurs in the highly conducting semimetal $\alpha$-WSi$_{2}$ single crystals leads to dramatically large changes in thermal conductivity at temperatures <100 K. At temperatures <20 K, where electron-phonon scattering is minimized, the thermal conductivity switching ratio between zero field and a 9T applied field can be >7. We extract the electronic and lattice components of the from the thermal conductivity measurements and show that the Lorenz number for this material approximates the theoretical value of L$_{0}$. From the heat capacity and thermal diffusivity, the speed of thermal conductivity switching is estimated to range from 1 x 10$^{-4}$ seconds at 5 K to 0.2 seconds at 100 K for a 5-mm long sample. This work shows that WSi$_{2}$, a highly conducting multi-carrier semimetal, is a promising thermal switch component for low-temperature applications such cyclical adiabatic demagnetization cooling, a technique that would enable replacing $^{3}$He-based refrigerators.


title: Revisiting Implicit Differentiation for Learning Problems in Optimal Control

abstract: This paper proposes a new method for differentiating through optimal trajectories arising from non-convex, constrained discrete-time optimal control (COC) problems using the implicit function theorem (IFT). Previous works solve a differential Karush-Kuhn-Tucker (KKT) system for the trajectory derivative, and achieve this efficiently by solving an auxiliary Linear Quadratic Regulator (LQR) problem. In contrast, we directly evaluate the matrix equations which arise from applying variable elimination on the Lagrange multiplier terms in the (differential) KKT system. By appropriately accounting for the structure of the terms within the resulting equations, we show that the trajectory derivatives scale linearly with the number of timesteps. Furthermore, our approach allows for easy parallelization, significantly improved scalability with model size, direct computation of vector-Jacobian products and improved numerical stability compared to prior works. As an additional contribution, we unify prior works, addressing claims that computing trajectory derivatives using IFT scales quadratically with the number of timesteps. We evaluate our method on a both synthetic benchmark and four challenging, learning from demonstration benchmarks including a 6-DoF maneuvering quadrotor and 6-DoF rocket powered landing.


title: Player Re-Identification Using Body Part Appearences

abstract: We propose a neural network architecture that learns body part appearances for soccer player re-identification. Our model consists of a two-stream network (one stream for appearance map extraction and the other for body part map extraction) and a bilinear-pooling layer that generates and spatially pools the body part map. Each local feature of the body part map is obtained by a bilinear mapping of the corresponding local appearance and body part descriptors. Our novel representation yields a robust image-matching feature map, which results from combining the local similarities of the relevant body parts with the weighted appearance similarity. Our model does not require any part annotation on the SoccerNet-V3 re-identification dataset to train the network. Instead, we use a sub-network of an existing pose estimation network (OpenPose) to initialize the part substream and then train the entire network to minimize the triplet loss. The appearance stream is pre-trained on the ImageNet dataset, and the part stream is trained from scratch for the SoccerNet-V3 dataset. We demonstrate the validity of our model by showing that it outperforms state-of-the-art models such as OsNet and InceptionNet.


title: Regularized Stokeslet Surfaces

abstract: An extension of the Method of Regularized Stokeslets (MRS) in three dimensions is developed for triangulated surfaces with a piecewise linear force distribution. The method extends the regularized Stokeslet segment methodology used for piecewise linear curves. By using analytic integration of the regularized Stokeslet kernel over the triangles, the regularization parameter $\epsilon$ is effectively decoupled from the spatial discretization of the surface. This is in contrast to the usual implementation of the method in which the regularization parameter is chosen for accuracy reasons to be about the same size as the spatial discretization. The validity of the method is demonstrated through several examples, including the flow around a rigidly translating/rotating sphere, a rotating spheroid, and the squirmer model for self-propulsion. Notably, second order convergence in the spatial discretization for fixed $\epsilon$ is demonstrated. Considerations of mesh design and choice of regularization parameter are discussed, and the performance of the method is compared with existing quadrature-based implementations.


title: An Electric Vehicle Control Strategy to Mitigate Load Altering Attacks Against Power Grids

abstract: Due to growing environmental concerns, the world's governments have been encouraging the shift of the transportation sector towards the adoption of Electric Vehicles (EVs). As a result, EV numbers have been growing exponentially and are expected to continue growing further which will add a large EV charging load to the power grid. To this end, this paper presents an EV-based defense mechanism against Load-Altering (LA) attacks targeting the grid. The developed mechanism utilizes H-infinity controllers and Linear Matrix Inequalities (LMIs) to mitigate LA attacks. After the controller synthesis and presentation of the attack scenarios, we demonstrate the effectiveness and success of our defense mechanism against the three known types of LA attacks. The scenarios include three 800 MW LA attacks against the New England 39-bus grid. The results demonstrate how our EV-based mitigation scheme eliminates the attack impacts and maintains the grid's stability in face of an unknown persisting attack.


title: The dressing field method for diffeomorphisms: a relational framework

abstract: The dressing field method is a tool to reduce gauge symmetries. Here we extend it to cover the case of diffeomorphisms. The resulting framework is a systematic scheme to produce Diff(M)-invariant objects, which has a natural relational interpretation. Its precise formulation relies on a clear understanding of the bundle geometry of field space. By detailing it, among other things we stress the geometric nature of field-independent and field-dependent diffeomorphisms, and highlight that the heuristic "extended bracket" for field-dependent vector fields often featuring in the covariant phase space literature can be understood as arising from the Fr\"olicher-Nijenhuis bracket. Furthermore, by articulating this bundle geometry with the covariant phase space approach, we give a streamlined account of the elementary objects of the (pre)symplectic structure of a Diff(M)-theory: Noether charges and their bracket, as induced by the standard prescription for the presymplectic potential and 2-form. We give conceptually transparent expressions allowing to read the integrability conditions and the circumstances under which the bracket of charge is Lie, and the resulting Poisson algebras of charges are central extensions of the Lie algebras of field-independent ($\mathfrak{diff}(M)$) and field-dependent vector fields. We show that, applying the dressing field method, one obtains a Diff(M)-invariant and manifestly relational formulation of a general relativistic field theory. Relying on results just mentioned, we easily derive the "dressed" (relational) presymplectic structure of the theory. This reproduces or extends results from the gravitational edge mode and gravitational dressing literature. In addition to simplified technical derivations, the conceptual clarity of the framework supplies several insights and allows us to dispel misconceptions.


title: Optimal exercise decision of American options under model uncertainty

abstract: Given the marginal distribution information of the underlying asset price at two future times $T_1$ and $T_2$, we consider the problem of determining a model-free upper bound on the price of a class of American options that must be exercised at either $T_1$ or $T_2$. The model uncertainty consistent with the given marginal information is described as the martingale optimal transport problem. We show that any option exercise scheme associated with any market model that jointly maximizes the expected option payoff must be nonrandomized if the American option payoff satisfies a suitable convexity condition and the model-free price upper bound and its relaxed version coincide. The latter condition is desired to be removed under appropriate conditions on the cost and marginals.


title: Building models in small cardinals in local abstract elementary classes

abstract: There are many results in the literature where superstablity-like independence notions, without any categoricity assumptions, have been used to show the existence of larger models. In this paper we show that \emph{stability} is enough to construct larger models for small cardinals assuming a mild locality condition for Galois types. $\mathbf{Theorem.}$ Suppose $\lambda<2^{\aleph_0}$. Let $\mathbf{K}$ be an abstract elementary class with $\lambda \geq LS(\mathbf{K})$. Assume $\mathbf{K}$ has amalgamation in $\lambda$, no maximal model in $\lambda$, and is stable in $\lambda$. If $\mathbf{K}$ is $(<\lambda^+, \lambda)$-local, then $\mathbf{K}$ has a model of cardinality $\lambda^{++}$. The set theoretic assumption that $\lambda<2^{\aleph_0}$ and model theoretic assumption of stability in $\lambda$ can be weakened to the model theoretic assumptions that $|\mathbf{S}^{na}(M)|< 2^{\aleph_0}$ for every $M \in \mathbf{K}_\lambda$ and stability for $\lambda$-algebraic types in $\lambda$. This is a significant improvement of Theorem 0.1., as the result holds on some unstable abstract elementary classes.


title: Eventual concavity properties of the heat flow

abstract: The eventual concavity properties are useful to characterize geometric properties of the final state of solutions to parabolic equations. In this paper we give characterizations of the eventual concavity properties of the heat flow for nonnegative, bounded measurable initial functions with compact support.


title: Effect of Equation of State and Cutoff Density in Smoothed Particle Hydrodynamics Simulations of the Moon-Forming Giant Impact

abstract: The amount of vapor in the impact-generated protolunar disk carries implications for the dynamics, devolatilization, and moderately volatile element (MVE) isotope fractionation during lunar formation. The equation of state (EoS) used in simulations of the giant impact is required to calculate the vapor mass fraction (VMF) of the modeled protolunar disk. Recently, a new version of M-ANEOS ("Stewart M-ANEOS") was released with an improved treatment of heat capacity and expanded experimental Hugoniot. Here, we compare this new M-ANEOS version with a previous version ("N-SPH M-ANEOS") and assess the resulting differences in smoothed particle hydrodynamics (SPH) simulations. We find that Stewart M-ANEOS results in cooler disks with smaller values of VMF and results in differences in disk mass that are dependent on the initial impact angle. We also assess the implications of the minimum "cutoff" density ($\rho_{c}$), similar to a maximum smoothing length, that is set as a fast-computing alternative to an iteratively calculated smoothing length. We find that the low particle resolution of the disk typically results in $>40\%$ of disk particles falling to $\rho_c$, influencing the dynamical evolution and VMF of the disk. Our results show that choice of EoS, $\rho_{c}$, and particle resolution can cause the VMF and disk mass to vary by tens of percent. Moreover, small values of $\rho_{c}$ produce disks that are prone to numerical instability and artificial shocks. We recommend that future giant impact SPH studies review smoothing methods and ensure the thermodynamic stability of the disk over simulated time.


title: First Detection and Modeling of Spatially Resolved Ly$\alpha$ in TW Hya

abstract: Lyman-$\alpha$ (Ly$\alpha$) is the strongest emission line in the accretion-generated UV spectra from T-Tauri stars and, as such, plays a critical role in regulating chemistry within the surrounding protoplanetary disks. Due to its resonant nature, the scattering of Ly$\alpha$ photons along the line-of-sight encodes information about the physical properties of the intervening H I medium. In this work, we present the first spatially resolved spectral images of Ly$\alpha$ emission across a protoplanetary disk in the iconic face-on T-Tauri star TW Hya, observed with HST-STIS at spatial offsets 0$''$, $\pm 0.2''$, and $\pm 0.4''$. To comprehensively interpret these Ly$\alpha$ spectra, we utilize a 3D Monte-Carlo Ly$\alpha$ radiative transfer simulation considering the H I wind and protoplanetary disk. From the simulation, we constrain the wind's properties: the H I column density $\sim 10^{20}\, \rm cm^{-2}$ and the outflow velocity $\sim 200\, \rm km\, s^{-1}$. Our findings indicate that successfully interpreting the observed spectra necessitates scattering contributions in the H I layer within the disk. Furthermore, to explore the effect of Ly$\alpha$ radiative transfer on protoplanetary disk chemistry, we compute the radiation field within the scattering medium and reveal that the wind reflection causes more Ly$\alpha$ photons to penetrate the disk. Our results show the necessity of spatially resolved Ly$\alpha$ observations of a broad range of targets, which will decode the complex interactions between the winds, protoplanetary disks, and surrounding environments.


title: GeoLM: Empowering Language Models for Geospatially Grounded Language Understanding

abstract: Humans subconsciously engage in geospatial reasoning when reading articles. We recognize place names and their spatial relations in text and mentally associate them with their physical locations on Earth. Although pretrained language models can mimic this cognitive process using linguistic context, they do not utilize valuable geospatial information in large, widely available geographical databases, e.g., OpenStreetMap. This paper introduces GeoLM, a geospatially grounded language model that enhances the understanding of geo-entities in natural language. GeoLM leverages geo-entity mentions as anchors to connect linguistic information in text corpora with geospatial information extracted from geographical databases. GeoLM connects the two types of context through contrastive learning and masked language modeling. It also incorporates a spatial coordinate embedding mechanism to encode distance and direction relations to capture geospatial context. In the experiment, we demonstrate that GeoLM exhibits promising capabilities in supporting toponym recognition, toponym linking, relation extraction, and geo-entity typing, which bridge the gap between natural language processing and geospatial sciences. The code is publicly available at https://github.com/knowledge-computing/geolm.


title: DetectGPT-SC: Improving Detection of Text Generated by Large Language Models through Self-Consistency with Masked Predictions

abstract: General large language models (LLMs) such as ChatGPT have shown remarkable success, but it has also raised concerns among people about the misuse of AI-generated texts. Therefore, an important question is how to detect whether the texts are generated by ChatGPT or by humans. Existing detectors are built on the assumption that there is a distribution gap between human-generated and AI-generated texts. These gaps are typically identified using statistical information or classifiers. In contrast to prior research methods, we find that large language models such as ChatGPT exhibit strong self-consistency in text generation and continuation. Self-consistency capitalizes on the intuition that AI-generated texts can still be reasoned with by large language models using the same logical reasoning when portions of the texts are masked, which differs from human-generated texts. Using this observation, we subsequently proposed a new method for AI-generated texts detection based on self-consistency with masked predictions to determine whether a text is generated by LLMs. This method, which we call DetectGPT-SC. We conducted a series of experiments to evaluate the performance of DetectGPT-SC. In these experiments, we employed various mask scheme, zero-shot, and simple prompt for completing masked texts and self-consistency predictions. The results indicate that DetectGPT-SC outperforms the current state-of-the-art across different tasks.


title: Attention-Enhancing Backdoor Attacks Against BERT-based Models

abstract: Recent studies have revealed that \textit{Backdoor Attacks} can threaten the safety of natural language processing (NLP) models. Investigating the strategies of backdoor attacks will help to understand the model's vulnerability. Most existing textual backdoor attacks focus on generating stealthy triggers or modifying model weights. In this paper, we directly target the interior structure of neural networks and the backdoor mechanism. We propose a novel Trojan Attention Loss (TAL), which enhances the Trojan behavior by directly manipulating the attention patterns. Our loss can be applied to different attacking methods to boost their attack efficacy in terms of attack successful rates and poisoning rates. It applies to not only traditional dirty-label attacks, but also the more challenging clean-label attacks. We validate our method on different backbone models (BERT, RoBERTa, and DistilBERT) and various tasks (Sentiment Analysis, Toxic Detection, and Topic Classification).


title: Efficient Heterogeneous Graph Learning via Random Projection

abstract: Heterogeneous Graph Neural Networks (HGNNs) are powerful tools for deep learning on heterogeneous graphs. Typical HGNNs require repetitive message passing during training, limiting efficiency for large-scale real-world graphs. Recent pre-computation-based HGNNs use one-time message passing to transform a heterogeneous graph into regular-shaped tensors, enabling efficient mini-batch training. Existing pre-computation-based HGNNs can be mainly categorized into two styles, which differ in how much information loss is allowed and efficiency. We propose a hybrid pre-computation-based HGNN, named Random Projection Heterogeneous Graph Neural Network (RpHGNN), which combines the benefits of one style's efficiency with the low information loss of the other style. To achieve efficiency, the main framework of RpHGNN consists of propagate-then-update iterations, where we introduce a Random Projection Squashing step to ensure that complexity increases only linearly. To achieve low information loss, we introduce a Relation-wise Neighbor Collection component with an Even-odd Propagation Scheme, which aims to collect information from neighbors in a finer-grained way. Experimental results indicate that our approach achieves state-of-the-art results on seven small and large benchmark datasets while also being 230% faster compared to the most effective baseline. Surprisingly, our approach not only surpasses pre-processing-based baselines but also outperforms end-to-end methods.


title: An Inexact Frank-Wolfe Algorithm for Composite Convex Optimization Involving a Self-Concordant Function

abstract: In this paper, we consider Frank-Wolfe-based algorithms for composite convex optimization problems with objective involving a logarithmically-homogeneous, self-concordant functions. Recent Frank-Wolfe-based methods for this class of problems assume an oracle that returns exact solutions of a linearized subproblem. We relax this assumption and propose a variant of the Frank-Wolfe method with inexact oracle for this class of problems. We show that our inexact variant enjoys similar convergence guarantees to the exact case, while allowing considerably more flexibility in approximately solving the linearized subproblem. In particular, our approach can be applied if the subproblem can be solved prespecified additive error or to prespecified relative error (even though the optimal value of the subproblem may not be uniformly bounded). Furthermore, our approach can also handle the situation where the subproblem is solved via a randomized algorithm that fails with positive probability. Our inexact oracle model is motivated by certain large-scale semidefinite programs where the subproblem reduces to computing an extreme eigenvalue-eigenvector pair, and we demonstrate the practical performance of our algorithm with numerical experiments on problems of this form.


title: "Why Should I Review This Paper?" Unifying Semantic, Topic, and Citation Factors for Paper-Reviewer Matching

abstract: As many academic conferences are overwhelmed by a rapidly increasing number of paper submissions, automatically finding appropriate reviewers for each submission becomes a more urgent need than ever. Various factors have been considered by previous attempts on this task to measure the expertise relevance between a paper and a reviewer, including whether the paper is semantically close to, shares topics with, and cites previous papers of the reviewer. However, the majority of previous studies take only one of these factors into account, leading to an incomprehensive evaluation of paper-reviewer relevance. To bridge this gap, in this paper, we propose a unified model for paper-reviewer matching that jointly captures semantic, topic, and citation factors. In the unified model, a contextualized language model backbone is shared by all factors to learn common knowledge, while instruction tuning is introduced to characterize the uniqueness of each factor by producing factor-aware paper embeddings. Experiments on four datasets (one of which is newly contributed by us) across different fields, including machine learning, computer vision, information retrieval, and data mining, consistently validate the effectiveness of our proposed UniPR model in comparison with state-of-the-art paper-reviewer matching methods and scientific pre-trained language models.


title: FlipDyn with Control: Resource Takeover Games with Dynamics

abstract: We present the FlipDyn, a dynamic game in which two opponents (a defender and an adversary) choose strategies to optimally takeover a resource that involves a dynamical system. At any time instant, each player can take over the resource and thereby control the dynamical system after incurring a state-dependent and a control-dependent costs. The resulting model becomes a hybrid dynamical system where the discrete state (FlipDyn state) determines which player is in control of the resource. Our objective is to compute the Nash equilibria of this dynamic zero-sum game. Our contributions are four-fold. First, for any non-negative costs, we present analytical expressions for the saddle-point value of the FlipDyn game, along with the corresponding Nash equilibrium (NE) takeover strategies. Second, for continuous state, linear dynamical systems with quadratic costs, we establish sufficient conditions under which the game admits a NE in the space of linear state-feedback policies. Third, for scalar dynamical systems with quadratic costs, we derive the NE takeover strategies and saddle-point values independent of the continuous state of the dynamical system. Fourth and finally, for higher dimensional linear dynamical systems with quadratic costs, we derive approximate NE takeover strategies and control policies which enable the computation of bounds on the value functions of the game in each takeover state. We illustrate our findings through a numerical study involving the control of a linear dynamical system in the presence of an adversary.


title: Intelligent Escape of Robotic Systems: A Survey of Methodologies, Applications, and Challenges

abstract: Intelligent escape is an interdisciplinary field that employs artificial intelligence (AI) techniques to enable robots with the capacity to intelligently react to potential dangers in dynamic, intricate, and unpredictable scenarios. As the emphasis on safety becomes increasingly paramount and advancements in robotic technologies continue to advance, a wide range of intelligent escape methodologies has been developed in recent years. This paper presents a comprehensive survey of state-of-the-art research work on intelligent escape of robotic systems. Four main methods of intelligent escape are reviewed, including planning-based methodologies, partitioning-based methodologies, learning-based methodologies, and bio-inspired methodologies. The strengths and limitations of existing methods are summarized. In addition, potential applications of intelligent escape are discussed in various domains, such as search and rescue, evacuation, military security, and healthcare. In an effort to develop new approaches to intelligent escape, this survey identifies current research challenges and provides insights into future research trends in intelligent escape.


title: Text Fact Transfer

abstract: Text style transfer is a prominent task that aims to control the style of text without inherently changing its factual content. To cover more text modification applications, such as adapting past news for current events and repurposing educational materials, we propose the task of text fact transfer, which seeks to transfer the factual content of a source text between topics without modifying its style. We find that existing language models struggle with text fact transfer, due to their inability to preserve the specificity and phrasing of the source text, and tendency to hallucinate errors. To address these issues, we design ModQGA, a framework that minimally modifies a source text with a novel combination of end-to-end question generation and specificity-aware question answering. Through experiments on four existing datasets adapted for text fact transfer, we show that ModQGA can accurately transfer factual content without sacrificing the style of the source text.


title: VQ-NeRF: Vector Quantization Enhances Implicit Neural Representations

abstract: Recent advancements in implicit neural representations have contributed to high-fidelity surface reconstruction and photorealistic novel view synthesis. However, the computational complexity inherent in these methodologies presents a substantial impediment, constraining the attainable frame rates and resolutions in practical applications. In response to this predicament, we propose VQ-NeRF, an effective and efficient pipeline for enhancing implicit neural representations via vector quantization. The essence of our method involves reducing the sampling space of NeRF to a lower resolution and subsequently reinstating it to the original size utilizing a pre-trained VAE decoder, thereby effectively mitigating the sampling time bottleneck encountered during rendering. Although the codebook furnishes representative features, reconstructing fine texture details of the scene remains challenging due to high compression rates. To overcome this constraint, we design an innovative multi-scale NeRF sampling scheme that concurrently optimizes the NeRF model at both compressed and original scales to enhance the network's ability to preserve fine details. Furthermore, we incorporate a semantic loss function to improve the geometric fidelity and semantic coherence of our 3D reconstructions. Extensive experiments demonstrate the effectiveness of our model in achieving the optimal trade-off between rendering quality and efficiency. Evaluation on the DTU, BlendMVS, and H3DS datasets confirms the superior performance of our approach.


title: Density Functional Theory Calculations on the Interstellar Formation of Biomolecules

abstract: The density functional theory (DFT) is the most versatile electronic structure method used in quantum chemical calculations, and is increasingly applied in astrochemical research. This mini-review provides an overview of the applications of DFT calculations in understanding the chemistry that occurs in star-forming regions. We survey investigations into the formation of biologically-relevant compounds such as nucleobases in the interstellar medium, and also covers the formation of both achiral and chiral amino acids, as well as biologically-relevant molecules such as sugars, and nitrogen-containing polycyclic aromatic hydrocarbons. Additionally, DFT calculations are used to estimate the potential barriers for chemical reactions in astronomical environments. We conclude by noting several areas that require more research, such as the formation pathways of chiral amino acids, complex sugars and other biologically-important molecules, and the role of environmental factors in the formation of interstellar biomolecules.


title: MSFormer: A Skeleton-multiview Fusion Method For Tooth Instance Segmentation

abstract: Recently, deep learning-based tooth segmentation methods have been limited by the expensive and time-consuming processes of data collection and labeling. Achieving high-precision segmentation with limited datasets is critical. A viable solution to this entails fine-tuning pre-trained multiview-based models, thereby enhancing performance with limited data. However, relying solely on two-dimensional (2D) images for three-dimensional (3D) tooth segmentation can produce suboptimal outcomes because of occlusion and deformation, i.e., incomplete and distorted shape perception. To improve this fine-tuning-based solution, this paper advocates 2D-3D joint perception. The fundamental challenge in employing 2D-3D joint perception with limited data is that the 3D-related inputs and modules must follow a lightweight policy instead of using huge 3D data and parameter-rich modules that require extensive training data. Following this lightweight policy, this paper selects skeletons as the 3D inputs and introduces MSFormer, a novel method for tooth segmentation. MSFormer incorporates two lightweight modules into existing multiview-based models: a 3D-skeleton perception module to extract 3D perception from skeletons and a skeleton-image contrastive learning module to obtain the 2D-3D joint perception by fusing both multiview and skeleton perceptions. The experimental results reveal that MSFormer paired with large pre-trained multiview models achieves state-of-the-art performance, requiring only 100 training meshes. Furthermore, the segmentation accuracy is improved by 2.4%-5.5% with the increasing volume of training data.


title: What is in Your App? Uncovering Privacy Risks of Female Health Applications

abstract: FemTech or Female Technology, is an expanding field dedicated to providing affordable and accessible healthcare solutions for women, prominently through Female Health Applications that monitor health and reproductive data. With the leading app exceeding 1 billion downloads, these applications are gaining widespread popularity. However, amidst contemporary challenges to women's reproductive rights and privacy, there is a noticeable lack of comprehensive studies on the security and privacy aspects of these applications. This exploratory study delves into the privacy risks associated with seven popular applications. Our initial quantitative static analysis reveals varied and potentially risky permissions and numerous third-party trackers. Additionally, a preliminary examination of privacy policies indicates non-compliance with fundamental data privacy principles. These early findings highlight a critical gap in establishing robust privacy and security safeguards for FemTech apps, especially significant in a climate where women's reproductive rights face escalating threats.


title: Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models

abstract: Recent work has shown that language models (LMs) have strong multi-step (i.e., procedural) reasoning capabilities. However, it is unclear whether LMs perform these tasks by cheating with answers memorized from pretraining corpus, or, via a multi-step reasoning mechanism. In this paper, we try to answer this question by exploring a mechanistic interpretation of LMs for multi-step reasoning tasks. Concretely, we hypothesize that the LM implicitly embeds a reasoning tree resembling the correct reasoning process within it. We test this hypothesis by introducing a new probing approach (called MechanisticProbe) that recovers the reasoning tree from the model's attention patterns. We use our probe to analyze two LMs: GPT-2 on a synthetic task (k-th smallest element), and LLaMA on two simple language-based reasoning tasks (ProofWriter & AI2 Reasoning Challenge). We show that MechanisticProbe is able to detect the information of the reasoning tree from the model's attentions for most examples, suggesting that the LM indeed is going through a process of multi-step reasoning within its architecture in many cases.


title: Robotic Arm Manipulation to Perform Rock Skipping in Simulation

abstract: Rock skipping is a highly dynamic and relatively complex task that can easily be performed by humans. This project aims to bring rock skipping into a robotic setting, utilizing the lessons we learned in Robotic Manipulation. Specifically, this project implements a system consisting of a robotic arm and dynamic environment to perform rock skipping in simulation. By varying important parameters such as release velocity, we hope to use our system to gain insight into the most important factors for maximizing the total number of skips. In addition, by implementing the system in simulation, we have a more rigorous and precise testing approach over these varied test parameters. However, this project experienced some limitations due to gripping inefficiencies and problems with release height trajectories which is further discussed in our report.


title: Quantum cluster algebras and 3D integrability: Tetrahedron and 3D reflection equations

abstract: We construct a new solution to the tetrahedron equation and the three-dimensional (3D) reflection equation by extending the quantum cluster algebra approach by Sun and Yagi concerning the former. We consider the Fock-Goncharov quivers associated with the longest elements of the Weyl groups of type $A$ and $C$, and investigate the cluster transformations corresponding to changing a reduced expression into a `most distant' one. By devising a new realization of the quantum $y$-variables in terms of $q$-Weyl algebra, the solutions are extracted as the operators whose adjoint actions yield the cluster transformations of the quantum $y$-variables. Explicit formulas of their matrix elements are also derived for some typical representations.

categories: math.QA hep-th math-ph math.GT math.MP nlin.SI


title: A 1-D Special Relativistic Shock Tube where Stellar Fluid undergoes Neutrino Heating

abstract: To investigate the physical nature of neutrino-heating on the result of a 1-dimensional core-collapse supernova. Colgate were the first to suggest that neutrinos may play a crucial role in core collapse supernova by taking up gravitational binding energy from the core and depositing it in the rest of the star. The fluid is contained in a shock tube in a region extending from the neutrino-sphere of a star out 1000 km, and irradiated with a neutrino flux emanating from the surface of the neutrino-sphere into the shock tube. Interaction due to electron-neutrino scattering off of fluid nucleons is used to account for neutrino heating of the fluid. The numerical method used is the Godunov method implementing an exact Riemann solver Rezzolla when needed. The simulated core-collapse produces an energy output of up to $10^{36}$J on a timescale of 3.33 s. It was found that the Godunov method performs very well using Sod data, with standard deviations of between $0.22-0.04$%. Thus, there is high confidence that the exact Riemann solver is working correctly and that the Godunov method is also reproducing the exact solutions to the Sod data with high confidence. A runtime of 3.33 s was used. The objective was to determine what would happen to the shock system over longer timescales, but the simulations showed an explosion in a much shorter time frame. It was found that the shock not only continues to move outward, but is also driven by large energy and pressure behind the shock. The density profiles show that fluid mass is pushed outward, but the fluid velocity actually reversed on timescales close to 3.33 s. In this paper, net mass movement occurs at 500-600 km and on a longer timescale of 3.33 s mass has moved out to 700 km. This supports the \emph{delayed post bounce shock mechanism}.


title: InstructExcel: A Benchmark for Natural Language Instruction in Excel

abstract: With the evolution of Large Language Models (LLMs) we can solve increasingly more complex NLP tasks across various domains, including spreadsheets. This work investigates whether LLMs can generate code (Excel OfficeScripts, a TypeScript API for executing many tasks in Excel) that solves Excel specific tasks provided via natural language user instructions. To do so we introduce a new large-scale benchmark, InstructExcel, created by leveraging the 'Automate' feature in Excel to automatically generate OfficeScripts from users' actions. Our benchmark includes over 10k samples covering 170+ Excel operations across 2,000 publicly available Excel spreadsheets. Experiments across various zero-shot and few-shot settings show that InstructExcel is a hard benchmark for state of the art models like GPT-4. We observe that (1) using GPT-4 over GPT-3.5, (2) providing more in-context examples, and (3) dynamic prompting can help improve performance on this benchmark.


title: Redundancy-Adaptive Multimodal Learning for Imperfect Data

abstract: Multimodal models trained on complete modality data often exhibit a substantial decrease in performance when faced with imperfect data containing corruptions or missing modalities. To address this robustness challenge, prior methods have explored various approaches from aspects of augmentation, consistency or uncertainty, but these approaches come with associated drawbacks related to data complexity, representation, and learning, potentially diminishing their overall effectiveness. In response to these challenges, this study introduces a novel approach known as the Redundancy-Adaptive Multimodal Learning (RAML). RAML efficiently harnesses information redundancy across multiple modalities to combat the issues posed by imperfect data while remaining compatible with the complete modality. Specifically, RAML achieves redundancy-lossless information extraction through separate unimodal discriminative tasks and enforces a proper norm constraint on each unimodal feature representation. Furthermore, RAML explicitly enhances multimodal fusion by leveraging fine-grained redundancy among unimodal features to learn correspondences between corrupted and untainted information. Extensive experiments on various benchmark datasets under diverse conditions have consistently demonstrated that RAML outperforms state-of-the-art methods by a significant margin.


title: Counterfactual Explanation Generation with s(CASP)

abstract: Machine learning models that automate decision-making are increasingly being used in consequential areas such as loan approvals, pretrial bail, hiring, and many more. Unfortunately, most of these models are black-boxes, i.e., they are unable to reveal how they reach these prediction decisions. A need for transparency demands justification for such predictions. An affected individual might desire explanations to understand why a decision was made. Ethical and legal considerations may further require informing the individual of changes in the input attribute that could be made to produce a desirable outcome. This paper focuses on the latter problem of automatically generating counterfactual explanations. Our approach utilizes answer set programming and the s(CASP) goal-directed ASP system. Answer Set Programming (ASP) is a well-known knowledge representation and reasoning paradigm. s(CASP) is a goal-directed ASP system that executes answer-set programs top-down without grounding them. The query-driven nature of s(CASP) allows us to provide justifications as proof trees, which makes it possible to analyze the generated counterfactual explanations. We show how counterfactual explanations are computed and justified by imagining multiple possible worlds where some or all factual assumptions are untrue and, more importantly, how we can navigate between these worlds. We also show how our algorithm can be used to find the Craig Interpolant for a class of answer set programs for a failing query.


title: Reforming Physics Exams Using Openly Accessible Large Isomorphic Problem Banks created with the assistance of Generative AI: an Explorative Study

abstract: This paper explores using large isomorphic problem banks to overcome many challenges of traditional exams in large STEM classes, especially the threat of content sharing websites and generative AI to the security of exam items. We first introduce an efficient procedure for creating large numbers of isomorphic physics problems, assisted by the large language model GPT-3 and several other open-source tools. We then propose that if exam items are randomly drawn from large enough problem banks, then giving students open access to problem banks prior to the exam will not dramatically impact students' performance on the exam or lead to wide-spread rote-memorization of solutions. We tested this hypothesis on two mid-term physics exams, comparing students' performance on problems drawn from open isomorphic problem banks to similar transfer problems that were not accessible to students prior to the exam. We found that on both exams, both open bank and transfer problems had the highest difficulty. The differences in percent correct were between 5% to 10%, which is comparable to the differences between different isomorphic versions of the same problem type. Item response theory analysis found that both types of problem have high discrimination (>1.5) with no significant differences. Student performance on open-bank and transfer problems are highly correlated with each other, and the correlations are stronger than average correlations between problems on the exam. Exploratory factor analysis also found that open-bank and transfer problems load on the same factor, and even formed their own factor on the second exam. Those observations all suggest that giving students open access to large isomorphic problem banks only had a small impact on students' performance on the exam but could have significant potential in reforming traditional classroom exams.