title: Towards Better Evaluation of Instruction-Following: A Case-Study in Summarization

abstract: Despite recent advances, evaluating how well large language models (LLMs) follow user instructions remains an open problem. While evaluation methods of language models have seen a rise in prompt-based approaches, limited work on the correctness of these methods has been conducted. In this work, we perform a meta-evaluation of a variety of metrics to quantify how accurately they measure the instruction-following abilities of LLMs. Our investigation is performed on grounded query-based summarization by collecting a new short-form, real-world dataset riSum, containing 300 document-instruction pairs with 3 answers each. All 900 answers are rated by 3 human annotators. Using riSum, we analyze the agreement between evaluation methods and human judgment. Finally, we propose new LLM-based reference-free evaluation methods that improve upon established baselines and perform on par with costly reference-based metrics that require high-quality summaries.


title: Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation

abstract: The task of Question Generation over Knowledge Bases (KBQG) aims to convert a logical form into a natural language question. For the sake of expensive cost of large-scale question annotation, the methods of KBQG under low-resource scenarios urgently need to be developed. However, current methods heavily rely on annotated data for fine-tuning, which is not well-suited for few-shot question generation. The emergence of Large Language Models (LLMs) has shown their impressive generalization ability in few-shot tasks. Inspired by Chain-of-Thought (CoT) prompting, which is an in-context learning strategy for reasoning, we formulate KBQG task as a reasoning problem, where the generation of a complete question is splitted into a series of sub-question generation. Our proposed prompting method KQG-CoT first retrieves supportive logical forms from the unlabeled data pool taking account of the characteristics of the logical form. Then, we write a prompt to explicit the reasoning chain of generating complicated questions based on the selected demonstrations. To further ensure prompt quality, we extend KQG-CoT into KQG-CoT+ via sorting the logical forms by their complexity. We conduct extensive experiments over three public KBQG datasets. The results demonstrate that our prompting method consistently outperforms other prompting baselines on the evaluated datasets. Remarkably, our KQG-CoT+ method could surpass existing few-shot SoTA results of the PathQuestions dataset by 18.25, 10.72, and 10.18 absolute points on BLEU-4, METEOR, and ROUGE-L, respectively.


title: Uncertainty-Aware Planning for Heterogeneous Robot Teams using Dynamic Topological Graphs and Mixed-Integer Programming

abstract: Planning under uncertainty is a fundamental challenge in robotics. For multi-robot teams, the challenge is further exacerbated, since the planning problem can quickly become computationally intractable as the number of robots increase. In this paper, we propose a novel approach for planning under uncertainty using heterogeneous multi-robot teams. In particular, we leverage the notion of a dynamic topological graph and mixed-integer programming to generate multi-robot plans that deploy fast scout team members to reduce uncertainty about the environment. We test our approach in a number of representative scenarios where the robot team must move through an environment while minimizing detection in the presence of uncertain observer positions. We demonstrate that our approach is sufficiently computationally tractable for real-time re-planning in changing environments, can improve performance in the presence of imperfect information, and can be adjusted to accommodate different risk profiles.


title: Assessing Marine Mammal Abundance: A Novel Data Fusion

abstract: Marine mammals are increasingly vulnerable to human disturbance and climate change. Their diving behavior leads to limited visual access during data collection, making studying the abundance and distribution of marine mammals challenging. In theory, using data from more than one observation modality should lead to better informed predictions of abundance and distribution. With focus on North Atlantic right whales, we consider the fusion of two data sources to inform about their abundance and distribution. The first source is aerial distance sampling which provides the spatial locations of whales detected in the region. The second source is passive acoustic monitoring (PAM), returning calls received at hydrophones placed on the ocean floor. Due to limited time on the surface and detection limitations arising from sampling effort, aerial distance sampling only provides a partial realization of locations. With PAM, we never observe numbers or locations of individuals. To address these challenges, we develop a novel thinned point pattern data fusion. Our approach leads to improved inference regarding abundance and distribution of North Atlantic right whales throughout Cape Cod Bay, Massachusetts in the US. We demonstrate performance gains of our approach compared to that from a single source through both simulation and real data.


title: Towards Design and Development of an ArUco Markers-Based Quantitative Surface Tactile Sensor

abstract: In this paper, with the goal of quantifying the qualitative image outputs of a Vision-based Tactile Sensor (VTS), we present the design, fabrication, and characterization of a novel Quantitative Surface Tactile Sensor (called QS-TS). QS-TS directly estimates the sensor's gel layer deformation in real-time enabling safe and autonomous tactile manipulation and servoing of delicate objects using robotic manipulators. The core of the proposed sensor is the utilization of miniature 1.5 mm x 1.5 mm synthetic square markers with inner binary patterns and a broad black border, called ArUco Markers. Each ArUco marker can provide real-time camera pose estimation that, in our design, is used as a quantitative measure for obtaining deformation of the QS-TS gel layer. Moreover, thanks to the use of ArUco markers, we propose a unique fabrication procedure that mitigates various challenges associated with the fabrication of the existing marker-based VTSs and offers an intuitive and less-arduous method for the construction of the VTS. Remarkably, the proposed fabrication facilitates the integration and adherence of markers with the gel layer to robustly and reliably obtain a quantitative measure of deformation in real-time regardless of the orientation of ArUco Markers. The performance and efficacy of the proposed QS-TS in estimating the deformation of the sensor's gel layer were experimentally evaluated and verified. Results demonstrate the phenomenal performance of the QS-TS in estimating the deformation of the gel layer with a relative error of <5%.


title: Phonon vortices at heavy impurities in two-dimensional materials

abstract: The advent of monochromated electron energy-loss spectroscopy has enabled atomic-resolution vibrational spectroscopy, which triggered interest in spatially localized or quasi-localized vibrational modes in materials. Here we report the discovery of phonon vortices at heavy impurities in two-dimensional materials. We use density-functional-theory calculations for two configurations of Si impurities in graphene, Si-C3 and Si-C4, to examine atom-projected phonon densities of states and display the atomic-displacement patterns for select modes that are dominated by impurity displacements. The vortices are driven by large displacements of the impurities, and reflect local symmetries. Similar vortices are found at phosphorus impurities in hexagonal boron nitride, suggesting that they may be a feature of heavy impurities in crystalline materials. Phonon vortices at defects are expected to play a role in thermal conductivity and other properties.


title: Koszul homomorphisms and universal resolutions in local algebra

abstract: We define a local homomorphism $(Q,k)\to (R,\ell)$ to be Koszul if its derived fiber $R \otimes^{\mathsf{L}}_Q k$ is formal, and if $\operatorname{Tor}^Q(R,k)$ is Koszul in the classical sense. This recovers the classical definition when $Q$ is a field, and more generally includes all flat deformations of Koszul algebras. The non-flat case is significantly more interesting, and there is no need for examples to be quadratic: all complete intersection and all Golod quotients are Koszul homomorphisms. We show that the class of Koszul homomorphisms enjoys excellent homological properties, and we give many more examples, especially various monomial and Gorenstein examples. We then study Koszul homomorphisms from the perspective of $\mathrm{A}_\infty$-structures on resolutions. We use this machinery to construct universal free resolutions of $R$-modules by generalizing a classical construction of Priddy. The resulting (infinite) free resolution of an $R$-module $M$ is often minimal, and can be described by a finite amount of data whenever $M$ and $R$ have finite projective dimension over $Q$. Our construction simultaneously recovers the resolutions of Shamash and Eisenbud over a complete intersection ring, and the bar resolutions of Iyengar and Burke over a Golod ring, and produces analogous resolutions for various other classes of local rings.


title: Performance/power assessment of CNN packages on embedded automotive platforms

abstract: The rise of power-efficient embedded computers based on highly-parallel accelerators opens a number of opportunities and challenges for researchers and engineers, and paved the way to the era of edge computing. At the same time, advances in embedded AI for object detection and categorization such as YOLO, GoogleNet and AlexNet reached an unprecedented level of accuracy (mean-Average Precision - mAP) and performance (Frames-Per-Second - FPS). Today, edge computers based on heterogeneous many-core systems are a predominant choice to deploy such systems in industry 4.0, wearable devices, and - our focus - autonomous driving systems. In these latter systems, engineers struggle to make reduced automotive power and size budgets co-exist with the accuracy and performance targets requested by autonomous driving. We aim at validating the effectiveness and efficiency of most recent networks on state-of-the-art platforms with embedded commercial-off-the-shelf System-on-Chips, such as Xavier AGX, Tegra X2 and Nano for NVIDIA and XCZU9EG and XCZU3EG of the Zynq UltraScale+ family, for the Xilinx counterpart. Our work aims at supporting engineers in choosing the most appropriate CNN package and computing system for their designs, and deriving guidelines for adequately sizing their systems.


title: Giant thermoelectric response of confined electrolytes with thermally activated charge carrier generation

abstract: The thermoelectric response of thermally activated electrolytes (TAE) in a slit channel is studied theoretically and by numerical simulations. The term TAE refers to electrolytes whose charge carrier concentration is a function of temperature, as recently suggested for ionic liquids and highly concentrated aqueous electrolyte solutions. Two competing mechanisms driving charge transport by temperature gradients are identified. For suitable values of the activation energy that governs the generation of charge carriers, a giant thermoelectric response is found, which could help explaining recent experimental results for nanoporous media infiltrated with TAEs.


title: Vault: Decentralized Storage Made Durable

abstract: The lack of centralized control, combined with highly dynamic adversarial behaviors, makes data durability a challenge in decentralized storage systems. In this work, we introduce a new storage system, Vault, that offers strong data durability guarantees in a fully decentralized, permission-less setting. Vault leverages the rateless property of erasure code to encode each data object into an infinite stream of encoding fragments. To ensure durability in the presence of dynamic Byzantine behaviors and targeted attacks, an infinite sequence of storage nodes are randomly selected to store encoding fragments. Encoding generation and candidate selection are fully decentralized: When necessary, Vault nodes use a gossip protocol and a publically verifiable selection proof to determine new fragments. Simulations and large-scale EC2 experiments demonstrate that Vault provides close-to-ideal mean-time-to-data-loss (MTTDL) with low storage redundancy, scales to more than 10,000 nodes, and attains performance comparable to IPFS


title: Sign reversal of the effective Hall coefficient in laminates

abstract: In the theory of composites, hierarchical laminate microstructures are known to often show optimal behavior. In this paper, their performance in the context of the Hall effect is evaluated. Using numerical calculations, it is shown that - despite the fact that they are the result of a simple layering process - they can mimic the behavior of chain-mail-inspired composites, which exhibit a sign-inversion of the effective Hall coefficient. To obtain such a hierarchical laminate, a two-step strategy is used: In the first step, a rank-three laminate with an effective $S$-tensor that has a sign-inverted trace is introduced. In the second step, the final isotropic hierarchical laminate is obtained from the rank-three laminate using an idea of Schulgasser's. As measured by the conductivity contrast required for the inversion as well as by the modulus of the obtained sign-inverted Hall coefficient, the identified hierarchical laminate performs better than the previously studied chain-mail-inspired composites.


title: Emergence of noise-induced barren plateaus in arbitrary layered noise models

abstract: In variational quantum algorithms the parameters of a parameterized quantum circuit are optimized in order to minimize a cost function that encodes the solution of the problem. The barren plateau phenomenon manifests as an exponentially vanishing dependence of the cost function with respect to the variational parameters, and thus hampers the optimization process. We discuss how, and in which sense, the phenomenon of noise-induced barren plateaus emerges in parameterized quantum circuits with a layered noise model. Previous results have shown the existence of noise-induced barren plateaus in the presence of local Pauli noise [arXiv:2007.14384]. We extend these results analytically to arbitrary completely-positive trace preserving maps in two cases: 1) when a parameter-shift rule holds, 2) when the parameterized quantum circuit at each layer forms a unitary $2$-design. The second example shows how highly expressive unitaries give rise not only to standard barren plateaus [arXiv:1803.11173], but also to noise-induced ones. In the second part of the paper, we study numerically the emergence of noise-induced barren plateaus in QAOA circuits focusing on the case of MaxCut problems on $d$-regular graphs and amplitude damping noise.


title: Tightening Bounds on Probabilities of Causation By Merging Datasets

abstract: Probabilities of Causation (PoC) play a fundamental role in decision-making in law, health care and public policy. Nevertheless, their point identification is challenging, requiring strong assumptions, in the absence of which only bounds can be derived. Existing work to further tighten these bounds by leveraging extra information either provides numerical bounds, symbolic bounds for fixed dimensionality, or requires access to multiple datasets that contain the same treatment and outcome variables. However, in many clinical, epidemiological and public policy applications, there exist external datasets that examine the effect of different treatments on the same outcome variable, or study the association between covariates and the outcome variable. These external datasets cannot be used in conjunction with the aforementioned bounds, since the former may entail different treatment assignment mechanisms, or even obey different causal structures. Here, we provide symbolic bounds on the PoC for this challenging scenario. We focus on combining either two randomized experiments studying different treatments, or a randomized experiment and an observational study, assuming causal sufficiency. Our symbolic bounds work for arbitrary dimensionality of covariates and treatment, and we discuss the conditions under which these bounds are tighter than existing bounds in literature. Finally, our bounds parameterize the difference in treatment assignment mechanism across datasets, allowing the mechanisms to vary across datasets while still allowing causal information to be transferred from the external dataset to the target dataset.


title: A quadric ansatz method for a certain class of second order PDEs

abstract: We develop a procedure to implement the method of quadric ansatz to a class of second order partial differential equations (PDEs), which includes the four-dimensional K\"ahler-Einstein equation with symmetry and the one-sided type-D Einstein equation with nonzero scalar curvature. The procedure, which reduces the PDEs to ordinary differential equations (ODEs), involves imposing additional constraints to the form of the ansatz, depending on the exact form of the PDEs. Thus its applicability varies within the class. We identify applicable subclasses of a class of modified Toda equations, one of which includes the K\"ahler-Einstein equation with symmetry, and give the corresponding reduced ODEs. In addition, we obtain a quadric ansatz reduction for a family of Einstein-Weyl equations in arbitrary dimensions. Lastly, we suggest a particular form of equations for which our procedure appears to be most effective as the aforementioned constraints vanish, and also present some reduction results using another type of ansatz, namely the hyperplane ansatz.


title: XLuminA: An Auto-differentiating Discovery Framework for Super-Resolution Microscopy

abstract: Driven by human ingenuity and creativity, the discovery of super-resolution techniques, which circumvent the classical diffraction limit of light, represent a leap in optical microscopy. However, the vast space encompassing all possible experimental configurations suggests that some powerful concepts and techniques might have not been discovered yet, and might never be with a human-driven direct design approach. Thus, AI-based exploration techniques could provide enormous benefit, by exploring this space in a fast, unbiased way. We introduce XLuminA, an open-source computational framework developed using JAX, which offers enhanced computational speed enabled by its accelerated linear algebra compiler (XLA), just-in-time compilation, and its seamlessly integrated automatic vectorization, auto-differentiation capabilities and GPU compatibility. Remarkably, XLuminA demonstrates a speed-up of 4 orders of magnitude compared to well-established numerical optimization methods. We showcase XLuminA's potential by re-discovering three foundational experiments in advanced microscopy. Ultimately, XLuminA identified a novel experimental blueprint featuring sub-diffraction imaging capabilities. This work constitutes an important step in AI-driven scientific discovery of new concepts in optics and advanced microscopy.


title: Characterizing Floquet topological phases by quench dynamics: A multiple-subsystem approach

abstract: We investigate the dynamical characterization theory for periodically driven systems in which Floquet topology can be fully detected by emergent topological patterns of quench dynamics in momentum subspaces called band-inversion surfaces. We improve the results of a recent work [Zhang et al., Phys. Rev. Lett. 125, 183001 (2020)] and propose a more flexible scheme to characterize a generic class of $d$-dimensional Floquet topological phases classified by $\mathbb{Z}$-valued invariants by applying a quench along an arbitrary spin-polarization axis. Our basic idea is that by disassembling the Floquet system into multiple static subsystems that are periodic in quasienergy, a full characterization of Floquet topological phases reduces to identifying a series of bulk topological invariants for time-independent Hamiltonians, which greatly enhances the convenience and flexibility of the measurement. We illustrate the scheme by numerically analyzing two experimentally realizable models in two and three dimensions, respectively, and adopting two different but equivalent viewpoints to examine the dynamical characterization. Finally, considering the imperfection of experiment, we demonstrate that the present scheme can also be applied to a general situation where the initial state is not completely polarized. This study provides an immediately implementable approach for dynamically classifying Floquet topological phases in ultracold atoms or other quantum simulators.


title: Evaluation of ChatGPT-Generated Medical Responses: A Systematic Review and Meta-Analysis

abstract: Large language models such as ChatGPT are increasingly explored in medical domains. However, the absence of standard guidelines for performance evaluation has led to methodological inconsistencies. This study aims to summarize the available evidence on evaluating ChatGPT's performance in medicine and provide direction for future research. We searched ten medical literature databases on June 15, 2023, using the keyword "ChatGPT". A total of 3520 articles were identified, of which 60 were reviewed and summarized in this paper and 17 were included in the meta-analysis. The analysis showed that ChatGPT displayed an overall integrated accuracy of 56% (95% CI: 51%-60%, I2 = 87%) in addressing medical queries. However, the studies varied in question resource, question-asking process, and evaluation metrics. Moreover, many studies failed to report methodological details, including the version of ChatGPT and whether each question was used independently or repeatedly. Our findings revealed that although ChatGPT demonstrated considerable potential for application in healthcare, the heterogeneity of the studies and insufficient reporting may affect the reliability of these results. Further well-designed studies with comprehensive and transparent reporting are needed to evaluate ChatGPT's performance in medicine.


title: Time-resolved Broadband Spectroscopy of Coherent Lattice Dynamics in a Rashba Material

abstract: Spintronics aims at establishing an information technology relying on the spins of electrons. Key to this vision is the spin-to-charge conversion (and vice versa) enabled by spin-orbit coupling, which represents the intimate bond between spins and charges. Here, we set the foundations to manipulate the spin-orbit coupling in Rashba systems in a coherent way at THz frequencies without parasitic electronic dissipation. Our approach relies on the generation of coherent lattice dynamics in BiTeI. Using ultrashort laser pulses ranging from the visible to the mid-infrared spectral range we establish quantitatively the conditions for an effective generation of coherent THz phonons, with the required symmetry for a manipulation of the Rashba coupling. Furthermore, we conclude an open discussion on the possibility of photoinducing of a spin current in BiTeI, proving that this is not the case. We envision a direct application of our pumping scheme in a photoemission experiment, which can directly disclose the THz dynamics of the Rashba splitting.


title: Non-reducible Modal Transition Systems

abstract: Modal Transition Systems (MTS) are a well-known formalism that extend Labelled Transition Systems (LTS) with the possibility of specifying necessary and permitted behaviour. Modal refinement ($\preceq_m$) of MTS represents a step of the design process, namely the one in which some optional behaviour is discarded while other optional behaviour becomes necessary. Whenever two MTS are not in modal refinement relation, it could still be the case that the set of implementations of one MTS is included in the set of implementations of the other. The challenge of devising an alternative notion of modal refinement that is both sound and complete with respect to the set of implementations, without disregarding valuable implementations, remains open. We introduce a subset of MTS called Non-reducible Modal Transition Systems (NMTS), together with a novel refinement relation $\preceq_n$ for NMTS. We illustrate through examples the additional constraints imposed by NMTS. Furthermore, we discuss a property holding for NMTS whose implementations are non-deterministic.


title: Control-Based Planning over Probability Mass Function Measurements via Robust Linear Programming

abstract: We propose an approach to synthesize linear feedback controllers for linear systems in polygonal environments. Our method focuses on designing a robust controller that can account for uncertainty in measurements. Its inputs are provided by a perception module that generates probability mass functions (PMFs) for predefined landmarks in the environment, such as distinguishable geometric features. We formulate an optimization problem with Control Lyapunov Function (CLF) and Control Barrier Function (CBF) constraints to derive a stable and safe controller. Using the strong duality of linear programs (LPs) and robust optimization, we convert the optimization problem to a linear program that can be efficiently solved offline. At a high level, our approach partially combines perception, planning, and real-time control into a single design problem. An additional advantage of our method is the ability to produce controllers capable of exhibiting nonlinear behavior while relying solely on an offline LP for control synthesis.


title: Confidence bounds for the true discovery proportion based on the exact distribution of the number of rejections

abstract: In multiple hypotheses testing it has become widely popular to make inference on the true discovery proportion (TDP) of a set $\mathcal{M}$ of null hypotheses. This approach is useful for several application fields, such as neuroimaging and genomics. Several procedures to compute simultaneous lower confidence bounds for the TDP have been suggested in prior literature. Simultaneity allows for post-hoc selection of $\mathcal{M}$. If sets of interest are specified a priori, it is possible to gain power by removing the simultaneity requirement. We present an approach to compute lower confidence bounds for the TDP if the set of null hypotheses is defined a priori. The proposed method determines the bounds using the exact distribution of the number of rejections based on a step-up multiple testing procedure under independence assumptions. We assess robustness properties of our procedure and apply it to real data from the field of functional magnetic resonance imaging.


title: The Connection Between Political Stability and Inflation: Insights from Four South Asian Nations

abstract: This study explores the relationship between political stability and inflation in four South Asian countries, employing panel data spanning from 2001 to 2021. To analyze this relationship, the study utilizes the dynamic ordinary least square (DOLS) and fully modified ordinary least square (FMOLS) methods, which account for cross-sectional dependence and slope homogeneity in panel data analysis. The findings consistently reveal that increased political stability is associated with lower inflation, while reduced political stability is linked to higher inflation.


title: Identifying reducible k-tuples of vectors with subspace-proximity sensitive hashing/filtering

abstract: We introduce and analyse a family of hash and predicate functions that are more likely to produce collisions for small reducible configurations of vectors. These may offer practical improvements to lattice sieving for short vectors. In particular, in one asymptotic regime the family exhibits significantly different convergent behaviour than existing hash functions and predicates.


title: Optimal Control for Continuous Dynamical Decoupling

abstract: We introduce a strategy to develop optimally designed fields for continuous dynamical decoupling (CDD). Our methodology obtains the optimal continuous field configuration to maximize the fidelity of a general one-qubit quantum gate. To achieve this, considering dephasing-noise perturbations, we employ an auxiliary qubit instead of the boson bath to implement a purification scheme, which results in unitary dynamics. Employing the sub-Riemannian geometry framework for the two-qubit unitary group, we derive and numerically solve the geodesic equations, obtaining the optimal time-dependent control Hamiltonian. Also, due to the extended time required to find solutions to the geodesic equations, we train a neural network on a subset of geodesic solutions, enabling us to promptly generate the time-dependent control Hamiltonian for any desired gate, which is crucial in circuit optimization.


title: Privacy-Preserved Aggregate Thermal Dynamic Model of Buildings

abstract: The thermal inertia of buildings brings considerable flexibility to the heating and cooling load, which is known to be a promising demand response resource. The aggregate model that can describe the thermal dynamics of the building cluster is an important interference for energy systems to exploit its intrinsic thermal inertia. However, the private information of users, such as the indoor temperature and heating/cooling power, needs to be collected in the parameter estimation procedure to obtain the aggregate model, causing severe privacy concerns. In light of this, we propose a novel privacy-preserved parameter estimation approach to infer the aggregate model for the thermal dynamics of the building cluster for the first time. Using it, the parameters of the aggregate thermal dynamic model (ATDM) can be obtained by the load aggregator without accessing the individual's privacy information. More specifically, this method not only exploits the block coordinate descent (BCD) method to resolve its non-convexity in the estimation but investigates the transformation-based encryption (TE) associated with its secure aggregation protocol (SAP) techniques to realize privacy-preserved computation. Its capability of preserving privacy is also theoretically proven. Finally, simulation results using real-world data demonstrate the accuracy and privacy-preserved performance of our proposed method.


title: Jailbreaking Black Box Large Language Models in Twenty Queries

abstract: There is growing interest in ensuring that large language models (LLMs) align with human values. However, the alignment of such models is vulnerable to adversarial jailbreaks, which coax LLMs into overriding their safety guardrails. The identification of these vulnerabilities is therefore instrumental in understanding inherent weaknesses and preventing future misuse. To this end, we propose Prompt Automatic Iterative Refinement (PAIR), an algorithm that generates semantic jailbreaks with only black-box access to an LLM. PAIR -- which is inspired by social engineering attacks -- uses an attacker LLM to automatically generate jailbreaks for a separate targeted LLM without human intervention. In this way, the attacker LLM iteratively queries the target LLM to update and refine a candidate jailbreak. Empirically, PAIR often requires fewer than twenty queries to produce a jailbreak, which is orders of magnitude more efficient than existing algorithms. PAIR also achieves competitive jailbreaking success rates and transferability on open and closed-source LLMs, including GPT-3.5/4, Vicuna, and PaLM-2.


title: Visual Attention Prompted Prediction and Learning

abstract: Visual explanation (attention)-guided learning uses not only labels but also explanations to guide model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation annotations that are time-consuming to prepare. However, in many real-world situations, it is usually desired to prompt the model with visual attention without model retraining. For example, when doing AI-assisted cancer classification on a medical image, users (e.g., clinicians) can provide the AI model with visual attention prompt on which areas are indispensable and which are precluded. Despite its promising objectives, achieving visual attention-prompted prediction presents several major challenges: 1) How can the visual prompt be effectively integrated into the model's reasoning process? 2) How should the model handle samples that lack visual prompts? 3) What is the impact on the model's performance when a visual prompt is imperfect? This paper introduces a novel framework for attention-prompted prediction and learning, utilizing visual prompts to steer the model's reasoning process. To improve performance in non-prompted situations and align it with prompted scenarios, we propose a co-training approach for both non-prompted and prompted models, ensuring they share similar parameters and activations. Additionally, for instances where the visual prompt does not encompass the entire input image, we have developed innovative attention prompt refinement methods. These methods interpolate the incomplete prompts while maintaining alignment with the model's explanations. Extensive experiments on four datasets demonstrate the effectiveness of our proposed framework in enhancing predictions for samples both with and without prompt.


title: SegLoc: Visual Self-supervised Learning Scheme for Dense Prediction Tasks of Security Inspection X-ray Images

abstract: Lately, remarkable advancements of artificial intelligence have been attributed to the integration of self-supervised learning (SSL) scheme. Despite impressive achievements within natural language processing (NLP), SSL in computer vision has not been able to stay on track comparatively. Recently, integration of contrastive learning on top of existing visual SSL models has established considerable progress, thereby being able to outperform supervised counterparts. Nevertheless, the improvements were mostly limited to classification tasks; moreover, few studies have evaluated visual SSL models in real-world scenarios, while the majority considered datasets containing class-wise portrait images, notably ImageNet. Thus, here, we have considered dense prediction tasks on security inspection x-ray images to evaluate our proposed model Segmentation Localization (SegLoc). Based upon the model Instance Localization (InsLoc), our model has managed to address one of the most challenging downsides of contrastive learning, i.e., false negative pairs of query embeddings. To do so, our pre-training dataset is synthesized by cutting, transforming, then pasting labeled segments, as foregrounds, from an already existing labeled dataset (PIDray) onto instances, as backgrounds, of an unlabeled dataset (SIXray;) further, we fully harness the labels through integration of the notion, one queue per class, into MoCo-v2 memory bank, avoiding false negative pairs. Regarding the task in question, our approach has outperformed random initialization method by 3% to 6%, while having underperformed supervised initialization, in AR and AP metrics at different IoU values for 20 to 30 pre-training epochs.


title: Pell and Pell-Lucas numbers as difference of two repdigits

abstract: Let $ \{P_{n}\}_{n\geq 0} $ be the sequence of Pell numbers defined by $ P_0=0 $, $ P_1 =1$ and $ P_{n+2}= 2P_{n+1} +P_n$ for all $ n\geq 0 $ and let $ \{Q_{n}\}_{n\geq 0} $ be its companion sequence, the Pell-Lucas numbers defined by $ Q_0=Q_1 =2$ and $ Q_{n+2}= 2Q_{n+1} +Q_n$ for all $ n\geq 0 $ . In this paper, we find all Pell and Pell-Lucas numbers which can be written as difference of two repdigits. It is shown that the largest Pell and Pell-Lucas numbers which can be written as difference of two repdigits are $$P_6=70= 77-7 \quad\quad \hbox{and} \quad\quad Q_7 = 478=555-77.$$


title: Dirac exciton-polariton condensates in photonic crystal gratings

abstract: Bound states in the continuum have recently been utilized in photonic crystal gratings to achieve strong coupling and ultralow power-driven condensation of bosonic exciton-polariton quasiparticles with atypical Dirac-like features in their dispersion relation. Here, we develop the single- and many-body theory of these new effective relativistic exciton-polaritons modes and describe their mean field condensation dynamics facilitated by the interplay between protection from the radiative continuum and negative-mass pump induced optical trapping. Our theory accounts for many tunable grating parameters giving full control over the diffractive coupling properties between guided polaritons and the radiative continuum previously unexplored in the context of driven condensation. In particular, we discover stable cyclical condensate solutions mimicking a driven-dissipative analog of the zitterbewegung effect characterized by coherent superposition of both ballistic (rapid phase front) and trapped (slow phase front) polariton waves. Finally, important distinctions are drawn between the concepts of near field and far field in the photonic grating, clarifying recent experimental observations on the emission characteristics of these long lived nonlinear Dirac polaritons.


title: Convexification Techniques for Fractional Programs

abstract: This paper develops a correspondence relating convex hulls of fractional functions with those of polynomial functions over the same domain. Using this result, we develop a number of new reformulations and relaxations for fractional programming problems. First, we relate 0-1 problems involving a ratio of affine functions with the boolean quadric polytope, and use inequalities for the latter to develop tighter formulations for the former. Second, we derive a new formulation to optimize a ratio of quadratic functions over a polytope using copositive programming. Third, we show that univariate fractional functions can be convexified using moment hulls. Fourth, we develop a new hierarchy of relaxations that converges finitely to the simultaneous convex hull of a collection of ratios of affine functions of 0-1 variables. Finally, we demonstrate theoretically and computationally that our techniques close a significant gap relative to state-of-the-art relaxations, require much less computational effort, and can solve larger problem instances.


title: Differentially Private Non-convex Learning for Multi-layer Neural Networks

abstract: This paper focuses on the problem of Differentially Private Stochastic Optimization for (multi-layer) fully connected neural networks with a single output node. In the first part, we examine cases with no hidden nodes, specifically focusing on Generalized Linear Models (GLMs). We investigate the well-specific model where the random noise possesses a zero mean, and the link function is both bounded and Lipschitz continuous. We propose several algorithms and our analysis demonstrates the feasibility of achieving an excess population risk that remains invariant to the data dimension. We also delve into the scenario involving the ReLU link function, and our findings mirror those of the bounded link function. We conclude this section by contrasting well-specified and misspecified models, using ReLU regression as a representative example. In the second part of the paper, we extend our ideas to two-layer neural networks with sigmoid or ReLU activation functions in the well-specified model. In the third part, we study the theoretical guarantees of DP-SGD in Abadi et al. (2016) for fully connected multi-layer neural networks. By utilizing recent advances in Neural Tangent Kernel theory, we provide the first excess population risk when both the sample size and the width of the network are sufficiently large. Additionally, we discuss the role of some parameters in DP-SGD regarding their utility, both theoretically and empirically.


title: Extensions of Heterogeneity in Integration and Prediction (HIP) with R Shiny Application

abstract: Multiple data views measured on the same set of participants is becoming more common and has the potential to deepen our understanding of many complex diseases by analyzing these different views simultaneously. Equally important, many of these complex diseases show evidence of subgroup heterogeneity (e.g., by sex or race). HIP (Heterogeneity in Integration and Prediction) is among the first methods proposed to integrate multiple data views while also accounting for subgroup heterogeneity to identify common and subgroup-specific markers of a particular disease. However, HIP is applicable to continuous outcomes and requires programming expertise by the user. Here we propose extensions to HIP that accommodate multi-class, Poisson, and Zero-Inflated Poisson outcomes while retaining the benefits of HIP. Additionally, we introduce an R Shiny application, accessible on shinyapps.io at https://multi-viewlearn.shinyapps.io/HIP_ShinyApp/, that provides an interface with the Python implementation of HIP to allow more researchers to use the method anywhere and on any device. We applied HIP to identify genes and proteins common and specific to males and females that are associated with exacerbation frequency. Although some of the identified genes and proteins show evidence of a relationship with chronic obstructive pulmonary disease (COPD) in existing literature, others may be candidates for future research investigating their relationship with COPD. We demonstrate the use of the Shiny application with a publicly available data. An R-package for HIP would be made available at https://github.com/lasandrall/HIP.


title: A distant descendant of the six-vertex model

abstract: In this paper we present a new solution of the star-triangle relation having positive Boltzmann weights. The solution defines an exactly solvable two-dimensional Ising-type (edge interaction) model of statistical mechanics where the local "spin variables" can take arbitrary integer values, i.e., the number of possible spin states at each site of the lattice is infinite. There is also an equivalent "dual" formulation of the model, where the spins take continuous real values on the circle. From algebraic point of view this model is closely related to the to the 6-vertex model. It is connected with the construction of an intertwiner for two infinite-dimensional representations of the quantum affine algebra $U_q(\widehat{sl}(2))$ without the highest and lowest weights. The partition function of the model in the large lattice limit is calculated by the inversion relation method. Amazingly, it coincides with the partition function of the off-critical 8-vertex free-fermion model.

categories: hep-th cond-mat.stat-mech math-ph math.MP


title: $SG$-classes, Singular Symplectic Geometry and Order-preserving Isomorphisms

abstract: The geometric theory of pseudo-differential and Fourier Integral Operators relies on the symplectic structure of cotangent bundles. If one is to study calculi with some specific feature adapted to a geometric situation, the corresponding notion of cotangent bundle needs to be adapted as well and leads to spaces with a singular symplectic structure. Analysing these singularities is a necessary step in order to construct the calculus itself. In this article we provide some new insights into the symplectic structures arising from asymptotically Euclidean manifolds. In particular, we study the action of the Poisson bracket on $SG$-pseudo-differential operators and define a new class of singular symplectomorphisms, taking into account the geometric picture. We then consider this notion in the context of the characterisation of order-preserving isomorphisms of the $SG$-algebra, and show that these are in fact given by conjugation with a Fourier Integral Operator of $SG$-type.


title: Revisiting Data Augmentation for Rotational Invariance in Convolutional Neural Networks

abstract: Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations. Convolutional layers are translation equivariant by design, but in their basic form lack invariances. In this work we investigate how best to include rotational invariance in a CNN for image classification. Our experiments show that networks trained with data augmentation alone can classify rotated images nearly as well as in the normal unrotated case; this increase in representational power comes only at the cost of training time. We also compare data augmentation versus two modified CNN models for achieving rotational invariance or equivariance, Spatial Transformer Networks and Group Equivariant CNNs, finding no significant accuracy increase with these specialized methods. In the case of data augmented networks, we also analyze which layers help the network to encode the rotational invariance, which is important for understanding its limitations and how to best retrain a network with data augmentation to achieve invariance to rotation.


title: Assessing of Soil Erosion Risk Through Geoinformation Sciences and Remote Sensing -- A Review

abstract: During past decades a marked manifestation of widespread erosion phenomena was studied worldwide. Global conservation community has launched campaigns at local, regional and continental level in developing countries for preservation of soil resources in order not only to stop or mitigate human impact on nature but also to improve life in rural areas introducing new approaches for soil cultivation. After the adoption of Sustainable Development Goals of UNs and launching several world initiatives such as the Land Degradation Neutrality (LDN) the world came to realize the very importance of the soil resources on which the biosphere relies for its existence. The main goal of the chapter is to review different types and structures erosion models as well as their applications. Several methods using spatial analysis capabilities of geographic information systems (GIS) are in operation for soil erosion risk assessment, such as Universal Soil Loss Equation (USLE), Revised Universal Soil Loss Equation (RUSLE) in operation worldwide and in the USA and MESALES model. These and more models are being discussed in the present work alongside more experimental models and methods for assessing soil erosion risk such as Artificial Intelligence (AI), Machine and Deep Learning, etc. At the end of this work, a prospectus for the future development of soil erosion risk assessment is drawn.

categories: cs.CV cond-mat.dis-nn physics.data-an physics.geo-ph


title: Neural Sampling in Hierarchical Exponential-family Energy-based Models

abstract: Bayesian brain theory suggests that the brain employs generative models to understand the external world. The sampling-based perspective posits that the brain infers the posterior distribution through samples of stochastic neuronal responses. Additionally, the brain continually updates its generative model to approach the true distribution of the external world. In this study, we introduce the Hierarchical Exponential-family Energy-based (HEE) model, which captures the dynamics of inference and learning. In the HEE model, we decompose the partition function into individual layers and leverage a group of neurons with shorter time constants to sample the gradient of the decomposed normalization term. This allows our model to estimate the partition function and perform inference simultaneously, circumventing the negative phase encountered in conventional energy-based models (EBMs). As a result, the learning process is localized both in time and space, and the model is easy to converge. To match the brain's rapid computation, we demonstrate that neural adaptation can serve as a momentum term, significantly accelerating the inference process. On natural image datasets, our model exhibits representations akin to those observed in the biological visual system. Furthermore, for the machine learning community, our model can generate observations through joint or marginal generation. We show that marginal generation outperforms joint generation and achieves performance on par with other EBMs.


title: Acceleration and focusing of multispecies ion beam using a converging laser-driven shock

abstract: We demonstrate an ion acceleration scheme capable of simultaneously focusing and accelerating a multispecies ion beam with monoenergetic spectra to a few micron radius. The focal length and ion mean energy can be independently controlled: the former by using a different front-surface shape and the latter by tuning the laser-plasma parameters. We interpret the results using simple models and validate the results using first-principles simulations. The scheme is applicable to different laser transverse profiles and multi-ion species target, and limiting factors for the ion focusing are delineated. The generated ion bean exhibits high charge, low emittance , and high energy flux and is of interest to various applications including inertial Confinement Fusion (ICF), high flux neutron generation, and biomedical applications.


title: A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writing

abstract: We evaluate a range of recent LLMs on English creative writing, a challenging and complex task that requires imagination, coherence, and style. We use a difficult, open-ended scenario chosen to avoid training data reuse: an epic narration of a single combat between Ignatius J. Reilly, the protagonist of the Pulitzer Prize-winning novel A Confederacy of Dunces (1980), and a pterodactyl, a prehistoric flying reptile. We ask several LLMs and humans to write such a story and conduct a human evalution involving various criteria such as fluency, coherence, originality, humor, and style. Our results show that some state-of-the-art commercial LLMs match or slightly outperform our writers in most dimensions; whereas open-source LLMs lag behind. Humans retain an edge in creativity, while humor shows a binary divide between LLMs that can handle it comparably to humans and those that fail at it. We discuss the implications and limitations of our study and suggest directions for future research.


title: Indirect Probe of Electroweak-Interacting Particles at $\mu$TRISTAN $\mu^+\mu^+$ Collider

abstract: Recently, a novel collider, called $\mu$TRISTAN, has been proposed, offering the capability to achieve high-energy collisions of anti-muons. This high-energy collider presents an exceptional opportunity for the discovery of electroweak-interacting massive particles (EWIMPs), which are predicted by various new physics models. In a lepton collider like $\mu$TRISTAN, the potential for discovering EWIMPs extends beyond their direct production. Quantum corrections arising from EWIMP loops can significantly enhance our prospects for discovery by precise measurement of Standard Model processes. This study focuses on the indirect detection method within the $\mu$TRISTAN experiment, with a specific emphasis on TeV-scale EWIMP dark matter scenarios that yield the correct thermal relic density. At collision energies for $ \sqrt{s} = O(1-10)$ TeV, these EWIMPs introduce noticeable effects, typically in the range of $O(0.1-1)$\%. Our findings indicate that at $\sqrt{s} = 2\, (10)$ TeV, with an integrated luminosity of 10 ab$^{-1}$, the $\mu$TRISTAN can detect Higgsino at a mass of 1.3 (2.5) TeV and Wino at a mass of 1.9 (3.8) TeV, assuming an optimistic level of systematic uncertainty in the observation of the Standard Model processes.


title: MUN-FRL: A Visual Inertial LiDAR Dataset for Aerial Autonomous Navigation and Mapping

abstract: This paper presents a unique outdoor aerial visual-inertial-LiDAR dataset captured using a multi-sensor payload to promote the global navigation satellite system (GNSS)-denied navigation research. The dataset features flight distances ranging from 300m to 5km, collected using a DJI M600 hexacopter drone and the National Research Council (NRC) Bell 412 Advanced Systems Research Aircraft (ASRA). The dataset consists of hardware synchronized monocular images, IMU measurements, 3D LiDAR point-clouds, and high-precision real-time kinematic (RTK)-GNSS based ground truth. Ten datasets were collected as ROS bags over 100 mins of outdoor environment footage ranging from urban areas, highways, hillsides, prairies, and waterfronts. The datasets were collected to facilitate the development of visual-inertial-LiDAR odometry and mapping algorithms, visual-inertial navigation algorithms, object detection, segmentation, and landing zone detection algorithms based upon real-world drone and full-scale helicopter data. All the datasets contain raw sensor measurements, hardware timestamps, and spatio-temporally aligned ground truth. The intrinsic and extrinsic calibrations of the sensors are also provided along with raw calibration datasets. A performance summary of state-of-the-art methods applied on the datasets is also provided.


title: 95 GeV Diphoton and $b \bar{b}$ Excesses in the General Next-to-Minimal Supersymmetric Standard Model

abstract: The CMS and ATLAS collaborations recently published their results searching for light Higgs bosons, using the complete Run 2 data of the LHC. Both reported an excess in the diphoton invariant mass distribution at $m_{\gamma \gamma} \simeq 95.4~{\rm GeV}$ with compatible signal strengths. The combined result corresponded to a local significance of $3.1\sigma$. Besides, the mass of the diphoton signal coincided with that of the $b\bar{b}$ excess observed at the LEP. Given the remarkable theoretical advantages of the general Next-to-Minimal Supersymmetric Standard Model, we interpret these excesses by the resonant productions of the singlet-dominated CP-even Higgs boson predicted by the theory. Using both analytic formulae and numerical results, we show that the idea can interpret the excesses by broad parameter space without contradicting current experimental restrictions, including those from the 125~{\rm GeV} Higgs data, the dark matter relic abundance and direct detection experiments, and the collider searches for supersymmetry and extra Higgs bosons. Although the explanations are scarcely affected by present Higgs data and the LHC search for supersymmetry, the dark matter physics may leave footprints on them. We also survey the other signals of the light Higgs boson at the LHC.


title: Cold Start Latency in Serverless Computing: A Systematic Review, Taxonomy, and Future Directions

abstract: Recently, academics and the corporate sector have paid attention to serverless computing, which enables dynamic scalability and an economic model. In serverless computing, users pay only for the time they actually spend using the resources. Although zero scaling optimises cost and resource utilisation, it is the fundamental reason for the serverless cold start problem. Various academic and corporate sector studies are being conducted to tackle the cold start problem, which has large research challenges. To study the "cold start" problem in serverless computing, this article provides a comprehensive literature overview of recent research. In addition, we present a detailed taxonomy of several approaches to addressing the issue of cold start latency in serverless computing. Several academic and industrial organisations have proposed methods for cutting down the cold start time and cold start frequency, and this taxonomy is being used to explore these methods. There are several categories in which a current study on cold start latency is organised: caching and application-level optimization-based solutions, as well as AI/ML-based solutions. We have analysed the current methods and grouped them into categories based on their commonalities and features. Finally, we conclude with a review of current challenges and possible future research directions.


title: Extreme mass-ratio inspiral and waveforms for a spinning body into a Kerr black hole via osculating geodesics and near-identity transformations

abstract: Understanding the orbits of spinning bodies in curved spacetime is important for modeling binary black hole systems with small mass ratios. At zeroth order in mass ratio, the smaller body moves on a geodesic. Post-geodesic effects are needed to model the system accurately. One very important post-geodesic effect is the gravitational self-force, which describes the small body's interaction with its own contribution to a binary's spacetime. Another post-geodesic effect, the spin-curvature force, is due to the smaller body's spin coupling to spacetime curvature. In this paper, we combine the leading orbit-averaged backreaction of point-particle gravitational-wave emission with the spin-curvature force to construct the worldline and gravitational waveform for a spinning body spiraling into a Kerr black hole. We use an osculating geodesic integrator, which treats the worldline as evolution through a sequence of geodesic orbits, as well as near-identity transformations, which eliminate dependence on orbital phases, allowing for fast computation of inspirals. The resulting inspirals and waveforms include all critical dynamical effects which govern such systems (orbit and precession frequencies, inspiral, strong-field gravitational-wave amplitudes), and as such form an effective first model for the inspiral of spinning bodies into Kerr black holes. We emphasize that our present calculation is not self consistent, since we neglect effects which enter at the same order as effects we include. However, our analysis demonstrates that the impact of spin-curvature forces can be incorporated into EMRI waveform tools with relative ease. The calculation is sufficiently modular that it should not be difficult to include neglected post-geodesic effects as efficient tools for computing them become available. (Abridged)


title: TensorMD: Scalable Tensor-Diagram based Machine Learning Interatomic Potential on Heterogeneous Many-Core Processors

abstract: Molecular dynamics simulations have emerged as a potent tool for investigating the physical properties and kinetic behaviors of materials at the atomic scale, particularly in extreme conditions. Ab initio accuracy is now achievable with machine learning based interatomic potentials. With recent advancements in high-performance computing, highly accurate and large-scale simulations become feasible. This study introduces TensorMD, a new machine learning interatomic potential (MLIP) model that integrates physical principles and tensor diagrams. The tensor formalism provides a more efficient computation and greater flexibility for use with other scientific codes. Additionally, we proposed several portable optimization strategies and developed a highly optimized version for the new Sunway supercomputer. Our optimized TensorMD can achieve unprecedented performance on the new Sunway, enabling simulations of up to 52 billion atoms with a time-to-solution of 31 ps/step/atom, setting new records for HPC + AI + MD.


title: Theory of weak localization in graphene with spin-orbit interaction

abstract: Theory of weak localization in graphene with Rashba splitting of energy spectrum is developed. Anomalous magnetoresistance caused by weak localization is calculated with account for inter- and intravalley, spin-orbit and spin-valley scattering processes. It is shown that the anomalous magnetoresistance is described by the expression different from the traditional Hikami-Larkin-Nagaoka formula. The reason is that the effect of Rashba splitting gives rise to the spin-orbit vector potential which is not reduced to a spin dephasing only. The developed theory can be applied to heterostructures of graphene with transition metal dichalcogenides.


title: Ly-alpha emission in low-redshift most metal-deficient compact star-forming galaxies

abstract: We present observations with the Cosmic Origins Spectrograph onboard the Hubble Space Telescope of nine most metal-deficient compact star-forming galaxies with oxygen abundances 12+log(O/H)=6.97-7.23, redshifts z=0.02811-0.13320, and stellar masses M*<10^7Msun. We aim to study the properties of Ly-alpha emission in these extremely metal-deficient objects. We find that all nine galaxies are Ly-alpha emitters (LAEs). We examine various relations between the Ly-alpha escape fraction fesc(Ly-alpha) and other characteristics - such as absolute UV magnitude, oxygen abundance, O32 ratio, stellar mass, Lyman-alpha luminosity and equivalent width EW(Ly-alpha), ionizing photon production efficiency and velocity separation Vsep between the two peaks of the Ly-alpha profile - of a large sample of LAEs, including our lowest-metallicity galaxies and other objects from the literature. We find a relatively tight correlation between fesc(Ly-alpha) and two characteristics, EW(Ly-alpha) and Vsep, whereas no correlation is found between fesc(Ly-alpha) and the oxygen abundance. We also find a relatively tight relation between the Ly-alpha and LyC escape fractions. We propose to use the latter relation to estimate indirectly the escaping ionizing radiation in LAEs, when direct measurements of LyC emission are not possible. We show that the global properties of low-z LAEs are very similar to those of z>6 galaxies. They are thus ideal local proxies for studying physical processes during the epoch of reionization of the Universe.


title: Debias the Training of Diffusion Models

abstract: Diffusion models have demonstrated compelling generation quality by optimizing the variational lower bound through a simple denoising score matching loss. In this paper, we provide theoretical evidence that the prevailing practice of using a constant loss weight strategy in diffusion models leads to biased estimation during the training phase. Simply optimizing the denoising network to predict Gaussian noise with constant weighting may hinder precise estimations of original images. To address the issue, we propose an elegant and effective weighting strategy grounded in the theoretically unbiased principle. Moreover, we conduct a comprehensive and systematic exploration to dissect the inherent bias problem deriving from constant weighting loss from the perspectives of its existence, impact and reasons. These analyses are expected to advance our understanding and demystify the inner workings of diffusion models. Through empirical evaluation, we demonstrate that our proposed debiased estimation method significantly enhances sample quality without the reliance on complex techniques, and exhibits improved efficiency compared to the baseline method both in training and sampling processes.


title: The Geometry of Monotone Operator Splitting Methods

abstract: We propose a geometric framework to describe and analyze a wide array of operator splitting methods for solving monotone inclusion problems. The initial inclusion problem, which typically involves several operators combined through monotonicity-preserving operations, is seldom solvable in its original form. We embed it in an auxiliary space, where it is associated with a surrogate monotone inclusion problem with a more tractable structure and which allows for easy recovery of solutions to the initial problem. The surrogate problem is solved by successive projections onto half-spaces containing its solution set. The outer approximation half-spaces are constructed by using the individual operators present in the model separately. This geometric framework is shown to encompass traditional methods as well as state-of-the-art asynchronous block-iterative algorithms, and its flexible structure provides a pattern to design new ones.


title: Essentially non-hourglass and non-tensile-instability SPH elastic dynamics

abstract: Since the tension instability was discovered in updated Lagrangian smoothed particle hydrodynamics (ULSPH) at the end of the 20th century, researchers have made considerable efforts to suppress its occurrence. However, up to the present day, this problem has not been fundamentally resolved. In this paper, the concept of hourglass modes is firstly introduced into ULSPH, and the inherent causes of tension instability in elastic dynamics are clarified based on this brand-new perspective. Specifically, we present an essentially non-hourglass formulation by decomposing the shear acceleration with the Laplacian operator, and a comprehensive set of challenging benchmark cases for elastic dynamics is used to showcase that our method can completely eliminate tensile instability by resolving hourglass modes. The present results reveal the true origin of tension instability and challenge the traditional understanding of its sources, i.e., hourglass modes are the real culprit behind inducing this instability in tension zones rather that the tension itself. Furthermore, a time integration scheme known as dual-criteria time stepping is adopted into the simulation of solids for the first time, to significantly enhance computational efficiency.


title: Risk-informed Resilience Planning of Transmission Systems Against Ice Storms

abstract: Ice storms, known for their severity and predictability, necessitate proactive resilience enhancement in power systems. Traditional approaches often overlook the endogenous uncertainties inherent in human decisions and underutilize predictive information like forecast accuracy and preparation time. To bridge these gaps, we proposed a two-stage risk-informed decision-dependent resilience planning (RIDDRP) for transmission systems against ice storms. The model leverages predictive information to optimize resource allocation, considering decision-dependent line failure uncertainties introduced by planning decisions and exogenous ice storm-related uncertainties. We adopt a dual-objective approach to balance economic efficiency and system resilience across both normal and emergent conditions. The first stage of the RDDIP model makes line hardening decisions, as well as the optimal sitting and sizing of energy storage. The second stage evaluates the risk-informed operation costs, considering both pre-event preparation and emergency operations. Case studies demonstrate the model's ability to leverage predictive information, leading to more judicious investment decisions and optimized utilization of dispatchable resources. We also quantified the impact of different properties of predictive information on resilience enhancement. The RIDDRP model provides grid operators and planners valuable insights for making risk-informed infrastructure investments and operational strategy decisions, thereby improving preparedness and response to future extreme weather events.


title: Towards Robust Multi-Modal Reasoning via Model Selection

abstract: The reasoning capabilities of LLM (Large Language Model) are widely acknowledged in recent research, inspiring studies on tool learning and autonomous agents. LLM serves as the "brain" of the agent, orchestrating multiple tools for collaborative multi-step task solving. Unlike methods invoking tools like calculators or weather APIs for straightforward tasks, multi-modal agents excel by integrating diverse AI models for complex challenges. However, current multi-modal agents neglect the significance of model selection: they primarily focus on the planning and execution phases, and will only invoke predefined task-specific models for each subtask, making the execution fragile. Meanwhile, other traditional model selection methods are either incompatible with or suboptimal for the multi-modal agent scenarios, due to ignorance of dependencies among subtasks arising by multi-step reasoning. To this end, we identify the key challenges therein and propose the $\textit{M}^3$ framework as a plug-in with negligible runtime overhead at test-time. This framework improves model selection and bolsters the robustness of multi-modal agents in multi-step reasoning. In the absence of suitable benchmarks, we create MS-GQA, a new dataset specifically designed to investigate the model selection challenge in multi-modal agents. Our experiments reveal that our framework enables dynamic model selection, considering both user inputs and subtask dependencies, thereby robustifying the overall reasoning process. Our code and benchmark: https://github.com/LINs-lab/M3.


title: Finite sections: stability, spectral pollution and asymptotics of condition numbers and pseudospectra

abstract: The stability of an approximating sequence $(A_n)$ for an operator $A$ usually requires, besides invertibility of $A$, the invertibility of further operators, say $B, C, \dots$, that are well-associated to the sequence $(A_n)$. We study this set, $\{A,B,C,\dots\}$, of so-called stability indicators of $(A_n)$ and connect it to the asymptotics of $\|A_n\|$, $\|A_n^{-1}\|$ and $\kappa(A_n)=\|A_n\|\|A_n^{-1}\|$ as well as to spectral pollution by showing that $\limsup {\rm Spec}_\varepsilon A_n= {\rm Spec}_\varepsilon A\cup{\rm Spec}_\varepsilon B\cup{\rm Spec}_\varepsilon C\cup\dots$. We further specify, for each of $\|A_n\|$, $\|A_n^{-1}\|$, $\kappa(A_n)$ and ${\rm Spec}_\varepsilon A_n$, under which conditions even convergence applies.


title: On moments of gaps between consecutive squarefree numbers

abstract: Let $s_1, s_2, s_3, \cdots$ be the set of squarefree numbers in ascending order. In this paper, we prove that the following asymptotic on moments of gaps between squarefree numbers \[ \sum_{s_{k+1} \le x} (s_{k+1} - s_k)^\gamma \sim B(\gamma) x \; \; \mbox{ with some constant} \; \; B(\gamma) > 0 \] is true for $0 \le \gamma < 3.75$. This improves the previous best range $0 \le \gamma < 3.6875$.


title: A note on digraph splitting

abstract: A tantalizing open problem, posed independently by Stiebitz in 1995 and by Alon in 2006, asks whether for every pair of integers $s,t \ge 1$ there exists a finite number $F(s,t)$ such that the vertex set of every digraph of minimum out-degree at least $F(s,t)$ can be partitioned into non-empty parts $A$ and $B$ such that the subdigraphs induced on $A$ and $B$ have minimum out-degree at least $s$ and $t$, respectively. In this short note, we prove that if $F(2,2)$ exists, then all the numbers $F(s,t)$ with $s,t\ge 1$ exist and satisfy $F(s,t)=\Theta(s+t)$. In consequence, the problem of Alon and Stiebitz reduces to the case $s=t=2$. Moreover, the numbers $F(s,t)$ with $s,t \ge 2$ either all exist and grow linearly, or all of them do not exist.


title: Monotone discretizations of levelset convex geometric PDEs

abstract: We introduce a novel algorithm that converges to level-set convex viscosity solutions of high-dimensional Hamilton-Jacobi equations. The algorithm is applicable to a broad class of curvature motion PDEs, as well as a recently developed Hamilton-Jacobi equation for the Tukey depth, which is a statistical depth measure of data points. A main contribution of our work is a new monotone scheme for approximating the direction of the gradient, which allows for monotone discretizations of pure partial derivatives in the direction of, and orthogonal to, the gradient. We provide a convergence analysis of the algorithm on both regular Cartesian grids and unstructured point clouds in any dimension and present numerical experiments that demonstrate the effectiveness of the algorithm in approximating solutions of the affine flow in two dimensions and the Tukey depth measure of high-dimensional datasets such as MNIST and FashionMNIST.


title: Proving the Potential of Skeleton Based Action Recognition to Automate the Analysis of Manual Processes

abstract: In manufacturing sectors such as textiles and electronics, manual processes are a fundamental part of production. The analysis and monitoring of the processes is necessary for efficient production design. Traditional methods for analyzing manual processes are complex, expensive, and inflexible. Compared to established approaches such as Methods-Time-Measurement (MTM), machine learning (ML) methods promise: Higher flexibility, self-sufficient & permanent use, lower costs. In this work, based on a video stream, the current motion class in a manual assembly process is detected. With information on the current motion, Key-Performance-Indicators (KPIs) can be derived easily. A skeleton-based action recognition approach is taken, as this field recently shows major success in machine vision tasks. For skeleton-based action recognition in manual assembly, no sufficient pre-work could be found. Therefore, a ML pipeline is developed, to enable extensive research on different (pre-) processing methods and neural nets. Suitable well generalizing approaches are found, proving the potential of ML to enhance analyzation of manual processes. Models detect the current motion, performed by an operator in manual assembly, but the results can be transferred to all kinds of manual processes.


title: Sub-zeptojoule detection of terahertz pulses by parametric frequency upconversion

abstract: We combine parametric frequency upconversion with single-photon counting technology to achieve detection sensitivity down to the terahertz (THz) single-photon level. Our relatively simple detection scheme employs a near-infrared ultrafast source, a GaP nonlinear crystal, optical filters, and a single photon avalanche diode. This configuration is capable of detecting a weak THz signal with an energy of 590 zJ contained within a single pulse. Through averaging over 50k data points, the configuration can resolve a 0.5 zJ pulse energy, corresponding to an average of 0.5 photon per pulse. The corresponding noise-equivalent power and THz-to-NIR photon detection efficiency are $4.1 \times 10^{-17} W/\sqrt{Hz}$ and 0.19%, respectively. To test our scheme, we perform spectroscopy of water vapor between 1.0 and 3.7 THz and obtain results in agreement with to those acquired with a standard electro-optic sampling (EOS) method. Our technique provides a 0.2 THz spectral resolution offering a fast alternative to EOS THz detection for monitoring specific spectral components in THz spectroscopy, imaging and communications applications.


title: Modeling Lead-vehicle Kinematics For Rear-end Crash Scenario Generation

abstract: The use of virtual safety assessment as the primary method for evaluating vehicle safety technologies has emphasized the importance of crash scenario generation. One of the most common crash types is the rear-end crash, which involves a lead vehicle and a following vehicle. Most studies have focused on the following vehicle, assuming that the lead vehicle maintains a constant acceleration/deceleration before the crash. However, there is no evidence for this premise in the literature. This study aims to address this knowledge gap by thoroughly analyzing and modeling the lead vehicle's behavior as a first step in generating rear-end crash scenarios. Accordingly, the study employed a piecewise linear model to parameterize the speed profiles of lead vehicles, utilizing two rear-end pre-crash/near-crash datasets. These datasets were merged and categorized into multiple sub-datasets; for each one, a multivariate distribution was constructed to represent the corresponding parameters. Subsequently, a synthetic dataset was generated using these distribution models and validated by comparison with the original combined dataset. The results highlight diverse lead-vehicle speed patterns, indicating that a more accurate model, such as the proposed piecewise linear model, is required instead of the conventional constant acceleration/deceleration model. Crashes generated with the proposed models accurately match crash data across the full severity range, surpassing existing lead-vehicle kinematics models in both severity range and accuracy. By providing more realistic speed profiles for the lead vehicle, the model developed in the study contributes to creating realistic rear-end crash scenarios and reconstructing real-life crashes.


title: Faster Ascending Auctions via Polymatroid Sum

abstract: We consider ascending auctions for finding Walrasian equilibria in markets with indivisible items and gross substitutes valuation functions. Each price increase step in the auction algorithm requires finding an inclusion-wise minimal maximal overdemanded set at the current prices. This can be formulated as a submodular function minimization problem. We observe that minimizing this submodular function corresponds to a polymatroid sum problem, and using this viewpoint, we give a fast and simple push-relabel algorithm for finding the minimal maximal overdemanded set. This improves on the previously best running time of Murota, Shioura and Yang (ISAAC 2013). Our algorithm is an adaptation of the push-relabel framework by Frank and Mikl\'os (JJIAM, 2012) to the particular setting. We obtain a further improvement for the special case of unit-supplies. Furthermore, we show that for gross substitutes valuations, the component-wise minimal competitive prices are the same as the minimal Walrasian prices. This enables us to derive monotonicity properties of the Walrasian prices. Namely, we show that the minimal Walrasian prices can only increase if supply decreases, or demand increases.


title: Metrics for popularity bias in dynamic recommender systems

abstract: Albeit the widespread application of recommender systems (RecSys) in our daily lives, rather limited research has been done on quantifying unfairness and biases present in such systems. Prior work largely focuses on determining whether a RecSys is discriminating or not but does not compute the amount of bias present in these systems. Biased recommendations may lead to decisions that can potentially have adverse effects on individuals, sensitive user groups, and society. Hence, it is important to quantify these biases for fair and safe commercial applications of these systems. This paper focuses on quantifying popularity bias that stems directly from the output of RecSys models, leading to over recommendation of popular items that are likely to be misaligned with user preferences. Four metrics to quantify popularity bias in RescSys over time in dynamic setting across different sensitive user groups have been proposed. These metrics have been demonstrated for four collaborative filtering based RecSys algorithms trained on two commonly used benchmark datasets in the literature. Results obtained show that the metrics proposed provide a comprehensive understanding of growing disparities in treatment between sensitive groups over time when used conjointly.


title: On a conjecture of Stolz in the toric case

abstract: In 1996 Stolz conjectured that a string manifold with positive Ricci curvature has vanishing Witten genus. Here we prove this conjecture for toric string Fano manifolds and for string torus manifolds admitting invariant metrics of non-negative sectional curvature.


title: A Plastic Scintillation Muon Veto for Sub-Kelvin Temperatures

abstract: Rare-event search experiments located on-surface, such as short-baseline reactor neutrino experiments, are often limited by muon-induced background events. Highly efficient muon vetos are essential to reduce the detector background and to reach the sensitivity goals. We demonstrate the feasibility of deploying organic plastic scintillators at sub-Kelvin temperatures. For the NUCLEUS experiment, we developed a cryogenic muon veto equipped with wavelength shifting fibers and a silicon photo multiplier operating inside a dilution refrigerator. The achievable compactness of cryostat-internal integration is a key factor in keeping the muon rate to a minimum while maximizing coverage. The thermal and light output properties of a plastic scintillation detector were examined. We report first data on the thermal conductivity and heat capacity of the polystyrene-based scintillator UPS-923A over a wide range of temperatures extending below one Kelvin. The light output was measured down to 0.8K and observed to increase by a factor of 1.61$\pm$0.05 compared to 300K. The development of an organic plastic scintillation muon veto operating in sub-Kelvin temperature environments opens new perspectives for rare-event searches with cryogenic detectors at sites lacking substantial overburden.


title: Discrete Riesz Potentials on Discrete Weighted Morrey Spaces

abstract: Let $0<\alpha<1$. We obtain the boundedness of the discrete fractional Hardy-Littlewood maximal operators ${\mathcal M}_\alpha$ on discrete weighted Lebesgue spaces. From this and a discrete version of Whitney decomposition theorem, we deduce the boundedness of the discrete Riesz potentials $I_\alpha$ on discrete weighted Lebesgue spaces. The boundedness of $I_\alpha$ on discrete weighted Morrey spaces is further obtained. Moreover, the boundedness of ${\mathcal M}_\alpha$ is also obtained which is new even for unweighted case.


title: A Survey of Heterogeneous Transfer Learning

abstract: The application of transfer learning, an approach utilizing knowledge from a source domain to enhance model performance in a target domain, has seen a tremendous rise in recent years, underpinning many real-world scenarios. The key to its success lies in the shared common knowledge between the domains, a prerequisite in most transfer learning methodologies. These methods typically presuppose identical feature spaces and label spaces in both domains, known as homogeneous transfer learning, which, however, is not always a practical assumption. Oftentimes, the source and target domains vary in feature spaces, data distributions, and label spaces, making it challenging or costly to secure source domain data with identical feature and label spaces as the target domain. Arbitrary elimination of these differences is not always feasible or optimal. Thus, heterogeneous transfer learning, acknowledging and dealing with such disparities, has emerged as a promising approach for a variety of tasks. Despite the existence of a survey in 2017 on this topic, the fast-paced advances post-2017 necessitate an updated, in-depth review. We therefore present a comprehensive survey of recent developments in heterogeneous transfer learning methods, offering a systematic guide for future research. Our paper reviews methodologies for diverse learning scenarios, discusses the limitations of current studies, and covers various application contexts, including Natural Language Processing, Computer Vision, Multimodality, and Biomedicine, to foster a deeper understanding and spur future research.


title: Schr\"odinger-Poisson systems with zero mass in the Sobolev limiting case

abstract: We study the existence of positive solutions for a class of systems which strongly couple a quasilinear Schr\"odinger equation driven by a weighted $N$-Laplace operator and without the mass term, and a higher-order fractional Poisson equation. Since the system is considered in $\mathbb R^N$, the limiting case for the Sobolev embedding, we consider nonlinearities with exponential growth. Existence is proved relying on the study of a corresponding Choquard equation in which the Riesz kernel is a sign-changing logarithm. This is in turn solved by means of a variational approximating procedure for an auxiliary Choquard equation where the logarithm is uniformly approximated by polynomial kernels.


title: DistillSpec: Improving Speculative Decoding via Knowledge Distillation

abstract: Speculative decoding (SD) accelerates large language model inference by employing a faster draft model for generating multiple tokens, which are then verified in parallel by the larger target model, resulting in the text generated according to the target model distribution. However, identifying a compact draft model that is well-aligned with the target model is challenging. To tackle this issue, we propose DistillSpec that uses knowledge distillation to better align the draft model with the target model, before applying SD. DistillSpec makes two key design choices, which we demonstrate via systematic study to be crucial to improving the draft and target alignment: utilizing on-policy data generation from the draft model, and tailoring the divergence function to the task and decoding strategy. Notably, DistillSpec yields impressive 10 - 45% speedups over standard SD on a range of standard benchmarks, using both greedy and non-greedy sampling. Furthermore, we combine DistillSpec with lossy SD to achieve fine-grained control over the latency vs. task performance trade-off. Finally, in practical scenarios with models of varying sizes, first using distillation to boost the performance of the target model and then applying DistillSpec to train a well-aligned draft model can reduce decoding latency by 6-10x with minimal performance drop, compared to standard decoding without distillation.


title: Multigap nodeless superconductivity in the topological semimetal PdTe

abstract: Recently PdTe was identified as a spin-orbit coupled topological Dirac semimetal and was claimed to exhibit both bulk-nodal and surface-nodeless superconducting gaps. Here we report the ultralow-temperature thermal conductivity measurements on PdTe single crystals with $T_c$ = 4.5 K to investigate its superconducting gap structure. It is found that the residual linear term $\kappa_0/T$ is negligible in zero magnetic field. Furthermore, the field dependence of $\kappa_0(H)/T$ exhibits an $\sf S$-shaped curve. These results suggest that PdTe has multiple nodeless superconducting gaps, which is at odds with the claimed bulk-nodal gap. The reason for the discrepancy is likely that previous angle-resolved photoemission spectroscopy measurements were only performed down to 2 K and cannot observe the smaller nodeless gap. The fully gapped superconducting state in PdTe is compatible with it being a topological superconductor candidate.


title: Willis elasticity from microcontinuum field theories: Asymptotics, microstructure-property relationships, and cloaking

abstract: Willis elasticity is an effective medium theory for linearly elastic composites that incorporates an unusual coupling between stress and velocity, as well as between momentum and strain. Interest in the theory peaked following the discovery that its formulation is invariant under curvilinear changes of coordinates and that, consequently, it can be used to inverse-design ``invisibility'' cloaks for elastodynamics. That said, the microstructure-property relationships in Willis elasticity are poorly understood and, in particular, the mechanics that underlie the coupling are largely unknown. Thus, no such cloaks were constructed. Here, we put forward the idea that Willis elasticity is a particular microcontinuum field theory where the (generalized) micro-displacements have been eliminated in favor of the macroscopic displacement field as if by Schur completion. The field theory is special in that it features an inertial coupling between the micro- and macro-displacements that, upon completion, re-emerges as the coupling term in Willis elasticity. Concretely, we analyze an asymptotic regime where mechanical lattices exhibit a kinematic enrichment with a strong (leading-order) inertial coupling. We provide, in closed-form, the resulting microstructure-property relationships. As an application, and in light of the gained insights, we design an ``invisibility'' cloak resolved into Willis-elastic mechanical lattices.


title: Crowdsourced and Automatic Speech Prominence Estimation

abstract: The prominence of a spoken word is the degree to which an average native listener perceives the word as salient or emphasized relative to its context. Speech prominence estimation is the process of assigning a numeric value to the prominence of each word in an utterance. These prominence labels are useful for linguistic analysis, as well as training automated systems to perform emphasis-controlled text-to-speech or emotion recognition. Manually annotating prominence is time-consuming and expensive, which motivates the development of automated methods for speech prominence estimation. However, developing such an automated system using machine-learning methods requires human-annotated training data. Using our system for acquiring such human annotations, we collect and open-source crowdsourced annotations of a portion of the LibriTTS dataset. We use these annotations as ground truth to train a neural speech prominence estimator that generalizes to unseen speakers, datasets, and speaking styles. We investigate design decisions for neural prominence estimation as well as how neural prominence estimation improves as a function of two key factors of annotation cost: dataset size and the number of annotations per utterance.


title: MotionDirector: Motion Customization of Text-to-Video Diffusion Models

abstract: Large-scale pre-trained diffusion models have exhibited remarkable capabilities in diverse video generations. Given a set of video clips of the same motion concept, the task of Motion Customization is to adapt existing text-to-video diffusion models to generate videos with this motion. For example, generating a video with a car moving in a prescribed manner under specific camera movements to make a movie, or a video illustrating how a bear would lift weights to inspire creators. Adaptation methods have been developed for customizing appearance like subject or style, yet unexplored for motion. It is straightforward to extend mainstream adaption methods for motion customization, including full model tuning, parameter-efficient tuning of additional layers, and Low-Rank Adaptions (LoRAs). However, the motion concept learned by these methods is often coupled with the limited appearances in the training videos, making it difficult to generalize the customized motion to other appearances. To overcome this challenge, we propose MotionDirector, with a dual-path LoRAs architecture to decouple the learning of appearance and motion. Further, we design a novel appearance-debiased temporal loss to mitigate the influence of appearance on the temporal training objective. Experimental results show the proposed method can generate videos of diverse appearances for the customized motions. Our method also supports various downstream applications, such as the mixing of different videos with their appearance and motion respectively, and animating a single image with customized motions. Our code and model weights will be released.


title: Belief formation and the persistence of biased beliefs

abstract: We propose a belief-formation model where agents attempt to discriminate between two theories, and where the asymmetry in strength between confirming and disconfirming evidence tilts beliefs in favor of theories that generate strong (and possibly rare) confirming evidence and weak (and frequent) disconfirming evidence. In our model, limitations on information processing provide incentives to censor weak evidence, with the consequence that for some discrimination problems, evidence may become mostly one-sided, independently of the true underlying theory. Sophisticated agents who know the characteristics of the censored data-generating process are not lured by this accumulation of ``evidence'', but less sophisticated ones end up with biased beliefs.


title: Teaching Resources for Embedding Ethics in Mathematics: Exercises, Projects, and Handouts

abstract: The resources compiled in this document provide an approach to embed and teach Ethics in Mathematics at the undergraduate level. We provide mathematical exercises and homework problems that teach students ethical awareness and transferable skills, for many of the standard courses in the first and second years of a university degree in mathematics or related courses with significant mathematical content (e.g., physics, engineering, computer science, economics, etc). In addition to the exercises, this document also contains a list of projects, essay topics, and handouts for use as final projects and in seminars. This is a living document, and additional contributions are welcome.


title: Machine Learning Assisted Cognitive Construction of a Shallow Depth Dynamic Ansatz for Noisy Quantum Hardware

abstract: The development of various dynamic ansatz-constructing techniques has ushered in a new era, rendering the practical exploitation of Noisy Intermediate-Scale Quantum (NISQ) hardware for molecular simulations increasingly viable. However, they exhibit substantial measurement costs during their execution. This work involves the development of a novel protocol that capitalizes on regenerative machine learning methodologies and many-body perturbation theoretic measures to construct a highly expressive and shallow ansatz within the variational quantum eigensolver (VQE) framework. The machine learning methodology is trained with the basis vectors of a low-rank expansion of the N-electron Hilbert space to identify the dominant high-rank excited determinants without requiring a large number of quantum measurements. These selected excited determinants are iteratively incorporated within the ansatz through their low-rank decomposition. The reduction in the number of quantum measurements and ansatz depth manifests in the robustness of our method towards hardware noise, as demonstrated through numerical applications. Furthermore, the proposed method is highly compatible with state-of-the-art neural error mitigation techniques. This approach significantly enhances the feasibility of quantum simulations in molecular systems, paving the way for impactful advancements in quantum computational chemistry.


title: The Riemannian geometry of the space of compact spacelike Cauchy hypersurfaces

abstract: We study the geometry of a weak Riemannian metric on the infinite dimensional manifold of compact spacelike Cauchy hypersurfaces in a globally hyperbolic spacetime. We show that the geodesic distance (i.e. the infimum of lengths of paths between two given points) is positive, and that the sectional curvature is well defined and non-positive.


title: Strategies and impact of learning curve estimation for CNN-based image classification

abstract: Learning curves are a measure for how the performance of machine learning models improves given a certain volume of training data. Over a wide variety of applications and models it was observed that learning curves follow -- to a large extent -- a power law behavior. This makes the performance of different models for a given task somewhat predictable and opens the opportunity to reduce the training time for practitioners, who are exploring the space of possible models and hyperparameters for the problem at hand. By estimating the learning curve of a model from training on small subsets of data only the best models need to be considered for training on the full dataset. How to choose subset sizes and how often to sample models on these to obtain estimates is however not researched. Given that the goal is to reduce overall training time strategies are needed that sample the performance in a time-efficient way and yet leads to accurate learning curve estimates. In this paper we formulate the framework for these strategies and propose several strategies. Further we evaluate the strategies for simulated learning curves and in experiments with popular datasets and models for image classification tasks.


title: WinSyn: A High Resolution Testbed for Synthetic Data

abstract: We present WinSyn, a unique dataset and testbed for creating high-quality synthetic data with procedural modeling techniques. The dataset contains high-resolution photographs of windows, selected from locations around the world, with 89,318 individual window crops showcasing diverse geometric and material characteristics. We evaluate a procedural model by training semantic segmentation networks on both synthetic and real images and then comparing their performances on a shared test set of real images. Specifically, we measure the difference in mean Intersection over Union (mIoU) and determine the effective number of real images to match synthetic data's training performance. We design a baseline procedural model as a benchmark and provide 21,290 synthetically generated images. By tuning the procedural model, key factors are identified which significantly influence the model's fidelity in replicating real-world scenarios. Importantly, we highlight the challenge of procedural modeling using current techniques, especially in their ability to replicate the spatial semantics of real-world scenarios. This insight is critical because of the potential of procedural models to bridge to hidden scene aspects such as depth, reflectivity, material properties, and lighting conditions.


title: The prismatic realization functor for Shimura varieties of abelian type

abstract: For the integral canonical model $\mathscr{S}_{\mathsf{K}^p}$ of a Shimura variety $\mathrm{Sh}_{\mathsf{K}_0\mathsf{K}^p}(\mathbf{G},\mathbf{X})$ of abelian type at hyperspecial level $K_0=\mathcal{G}(\mathbb{Z}_p)$, we construct a prismatic $F$-gauge model for the `universal' $\mathcal{G}(\mathbb{Z}_p)$-local system on $\mathrm{Sh}_{\mathsf{K}_0\mathsf{K}^p}(\mathbf{G},\mathbf{X})$. We use this to obtain new $p$-adic information about these Shimura varieties, notably an abelian-type analogue of the Serre--Tate theorem (realizing an expectation of Drinfeld in the abelian-type case) and a prismatic characterization of these models. To do this, we make several advances in integral $p$-adic Hodge theory, notably the development of an integral analogue of the functor $D_{\mathrm{crys}}$.


title: No-Regret Learning and Equilibrium Computation in Quantum Games

abstract: As quantum processors advance, the emergence of large-scale decentralized systems involving interacting quantum-enabled agents is on the horizon. Recent research efforts have explored quantum versions of Nash and correlated equilibria as solution concepts of strategic quantum interactions, but these approaches did not directly connect to decentralized adaptive setups where agents possess limited information. This paper delves into the dynamics of quantum-enabled agents within decentralized systems that employ no-regret algorithms to update their behaviors over time. Specifically, we investigate two-player quantum zero-sum games and polymatrix quantum zero-sum games, showing that no-regret algorithms converge to separable quantum Nash equilibria in time-average. In the case of general multi-player quantum games, our work leads to a novel solution concept, (separable) quantum coarse correlated equilibria (QCCE), as the convergent outcome of the time-averaged behavior no-regret algorithms, offering a natural solution concept for decentralized quantum systems. Finally, we show that computing QCCEs can be formulated as a semidefinite program and establish the existence of entangled (i.e., non-separable) QCCEs, which cannot be approached via the current paradigm of no-regret learning.