title: 360+x: A Panoptic Multi-modal Scene Understanding Dataset

abstract: Human perception of the world is shaped by a multitude of viewpoints and modalities. While many existing datasets focus on scene understanding from a certain perspective (e.g. egocentric or third-person views), our dataset offers a panoptic perspective (i.e. multiple viewpoints with multiple data modalities). Specifically, we encapsulate third-person panoramic and front views, as well as egocentric monocular/binocular views with rich modalities including video, multi-channel audio, directional binaural delay, location data and textual scene descriptions within each scene captured, presenting comprehensive observation of the world. Figure 1 offers a glimpse of all 28 scene categories of our 360+x dataset. To the best of our knowledge, this is the first database that covers multiple viewpoints with multiple data modalities to mimic how daily information is accessed in the real world. Through our benchmark analysis, we presented 5 different scene understanding tasks on the proposed 360+x dataset to evaluate the impact and benefit of each data modality and perspective in panoptic scene understanding. We hope this unique dataset could broaden the scope of comprehensive scene understanding and encourage the community to approach these problems from more diverse perspectives.


title: Exploring the Nexus of Large Language Models and Legal Systems: A Short Survey

abstract: With the advancement of Artificial Intelligence (AI) and Large Language Models (LLMs), there is a profound transformation occurring in the realm of natural language processing tasks within the legal domain. The capabilities of LLMs are increasingly demonstrating unique roles in the legal sector, bringing both distinctive benefits and various challenges. This survey delves into the synergy between LLMs and the legal system, such as their applications in tasks like legal text comprehension, case retrieval, and analysis. Furthermore, this survey highlights key challenges faced by LLMs in the legal domain, including bias, interpretability, and ethical considerations, as well as how researchers are addressing these issues. The survey showcases the latest advancements in fine-tuned legal LLMs tailored for various legal systems, along with legal datasets available for fine-tuning LLMs in various languages. Additionally, it proposes directions for future research and development.


title: Optical solitons in multimode fibers: recent advances

abstract: Optical solitons in multimode fibers have been predicted 40 years ago and extensively investigated theoretically. Transmission experiments in nonlinear multimode fibers have gained renewed interest, motivated by their potential to extend the capacity of long-distance transmission systems; only in the last few years, new experiments have revealed unexpected properties of optical solitons propagating in graded-index and step-index multimode fibers, partially re-writing the existing theory. Here we provide an overview of the recent experimental, numerical and theoretical studies which revealed those new properties. It will be shown that multimode fiber solitons form with specific pulse width and energy dependent on the wavelength, and that they naturally evolve toward fundamental-mode Raman solitons. New soliton fission mechanisms, governed by the modal dispersion, will be explained. Possible applications in space-division multiplexed systems will be discussed. A recent thermodynamic approach to soliton condensation will be described.


title: SGCNeRF: Few-Shot Neural Rendering via Sparse Geometric Consistency Guidance

abstract: Neural Radiance Field (NeRF) technology has made significant strides in creating novel viewpoints. However, its effectiveness is hampered when working with sparsely available views, often leading to performance dips due to overfitting. FreeNeRF attempts to overcome this limitation by integrating implicit geometry regularization, which incrementally improves both geometry and textures. Nonetheless, an initial low positional encoding bandwidth results in the exclusion of high-frequency elements. The quest for a holistic approach that simultaneously addresses overfitting and the preservation of high-frequency details remains ongoing. This study introduces a novel feature matching based sparse geometry regularization module. This module excels in pinpointing high-frequency keypoints, thereby safeguarding the integrity of fine details. Through progressive refinement of geometry and textures across NeRF iterations, we unveil an effective few-shot neural rendering architecture, designated as SGCNeRF, for enhanced novel view synthesis. Our experiments demonstrate that SGCNeRF not only achieves superior geometry-consistent outcomes but also surpasses FreeNeRF, with improvements of 0.7 dB and 0.6 dB in PSNR on the LLFF and DTU datasets, respectively.


title: Space of initial conditions for the four-dimensional Garnier system revisited

abstract: A geometric study is given for the 4-dimensional Garnier system. By the resolution of indeterminacy, the group of its B\"aklund transformations is lifted to a group of pseudo-isomorphisms between rational varieties obtained from ${\mathbb P}^2 \times {\mathbb P}^2$ by 10 or 21 blow-ups. The root basis is discussed in the N\'eron-Severi bilattices for the space with 10 blow-ups.


title: AMOR: Ambiguous Authorship Order

abstract: As we all know, writing scientific papers together with our beloved colleagues is a truly remarkable experience (partially): endless discussions about the same useless paragraph over and over again, followed by long days and long nights -- both at the same time. What a wonderful ride it is! What a beautiful life we have. But wait, there's one tiny little problem that utterly shatters the peace, turning even renowned scientists into bloodthirsty monsters: author order. The reason is that, contrary to widespread opinion, it's not the font size that matters, but the way things are ordered. Of course, this is a fairly well-known fact among scientists all across the planet (and beyond) and explains clearly why we regularly have to read about yet another escalated paper submission in local police reports. In this paper, we take an important step backwards to tackle this issue by solving the so-called author ordering problem (AOP) once and for all. Specifically, we propose AMOR, a system that replaces silly constructs like co-first or co-middle authorship with a simple yet easy probabilistic approach based on random shuffling of the author list at viewing time. In addition to AOP, we also solve the ambiguous author ordering citation problem} (AAOCP) on the fly. Stop author violence, be human.


title: PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generation

abstract: Visual layout plays a critical role in graphic design fields such as advertising, posters, and web UI design. The recent trend towards content-aware layout generation through generative models has shown promise, yet it often overlooks the semantic intricacies of layout design by treating it as a simple numerical optimization. To bridge this gap, we introduce PosterLlama, a network designed for generating visually and textually coherent layouts by reformatting layout elements into HTML code and leveraging the rich design knowledge embedded within language models. Furthermore, we enhance the robustness of our model with a unique depth-based poster augmentation strategy. This ensures our generated layouts remain semantically rich but also visually appealing, even with limited data. Our extensive evaluations across several benchmarks demonstrate that PosterLlama outperforms existing methods in producing authentic and content-aware layouts. It supports an unparalleled range of conditions, including but not limited to unconditional layout generation, element conditional layout generation, layout completion, among others, serving as a highly versatile user manipulation tool.


title: Charge density wave without long-range structural modulation in canted antiferromagnetic kagome FeGe

abstract: Strongly correlated electron systems with a kagome lattice can host abundant exotic quantum states such as superconductivity and spin/charge density waves (CDW) due to the complicated interactions between different degrees of freedoms in the framework of a unique two-dimensional geometrically frustrated lattice structure. Recently, successive orders of A-type antiferromagnetism (AFM), $2\times2\times2$ CDW and canted double-cone AFM have been manifested upon cooling in magnetic kagome FeGe. However, the mechanism of the CDW order and its interaction with magnetism are presently enigmatic at best. Here we investigate the evolution of CDW order with temperature across the spin canting transition in FeGe by single-crystal x-ray diffraction. Refinements of its modulated structure are presented using the superspace approach. Interestingly, the superlattice reflections originating from CDW-induced long-range structural modulation become extremely weak after the system enters the canted AFM while a $2\times2$ CDW in the $ab$ plane persists as a long-range order demonstrated by strong electronic modulation in the d$I$/d$V$ map of scanning tunneling spectroscopy. We discovered a novel CDW order without long-range structural modulation in FeGe probably because of the competition between CDW and canted AFM in determining the underlying crystal structure. In addition, occupational modulations of Ge1 atoms located in the kagome plane and displacive modulations of all the atoms were extracted from the refinements, confirming the existence of Ge atom dimerization along the $c$ axis as the major distortion and indicating a dynamic transformation between different CDW domains.


title: Magnetic axion vortex and very light QCD axions

abstract: We show that a stable vortex soliton, carrying a constant magnetic flux, exists in the homogeneous medium of axions with a constant time-derivative. Axions can be bound in the vortex, having energy less than the axion mass. If the observed magnetic fields in galaxies are those of the vortex, the axion-photon coupling has to be smaller than $10^{-17}\,{\rm GeV^{-1}}$. Otherwise, axions decay too quickly to constitute dark matter in galaxies.


title: LLM-RadJudge: Achieving Radiologist-Level Evaluation for X-Ray Report Generation

abstract: Evaluating generated radiology reports is crucial for the development of radiology AI, but existing metrics fail to reflect the task's clinical requirements. This study proposes a novel evaluation framework using large language models (LLMs) to compare radiology reports for assessment. We compare the performance of various LLMs and demonstrate that, when using GPT-4, our proposed metric achieves evaluation consistency close to that of radiologists. Furthermore, to reduce costs and improve accessibility, making this method practical, we construct a dataset using LLM evaluation results and perform knowledge distillation to train a smaller model. The distilled model achieves evaluation capabilities comparable to GPT-4. Our framework and distilled model offer an accessible and efficient evaluation method for radiology report generation, facilitating the development of more clinically relevant models. The model will be further open-sourced and accessible.


title: What Causes the Failure of Explicit to Implicit Discourse Relation Recognition?

abstract: We consider an unanswered question in the discourse processing community: why do relation classifiers trained on explicit examples (with connectives removed) perform poorly in real implicit scenarios? Prior work claimed this is due to linguistic dissimilarity between explicit and implicit examples but provided no empirical evidence. In this study, we show that one cause for such failure is a label shift after connectives are eliminated. Specifically, we find that the discourse relations expressed by some explicit instances will change when connectives disappear. Unlike previous work manually analyzing a few examples, we present empirical evidence at the corpus level to prove the existence of such shift. Then, we analyze why label shift occurs by considering factors such as the syntactic role played by connectives, ambiguity of connectives, and more. Finally, we investigate two strategies to mitigate the label shift: filtering out noisy data and joint learning with connectives. Experiments on PDTB 2.0, PDTB 3.0, and the GUM dataset demonstrate that classifiers trained with our strategies outperform strong baselines.


title: On the Synchronization Analysis of a Strong Competition Kuramoto Model

abstract: When modeling the classical Kuramoto model, one of the key features is the tendency to synchronize. Accordingly, the most well-adopted choice of the coupling function is the sine function. Due to the oddness of the sine function, the synchronized frequency would be the average of all the natural frequencies. In this article, we study the synchronization behaviors of the Kuramoto model with a pure competition coupling function. Namely, instead of the sine function, we choose $\max \{0, \sin \theta \}$ to be the coupling function. This indicates the relation of pure competition between oscillators. We prove asymptotical phase synchronization for identical oscillators and asymptotical frequency synchronization for non-identical oscillators under reasonable sufficient conditions. In particular, under our sufficient conditions, the synchronized frequency is the maximal frequency of all the natural frequencies. On the other hand, in the parameter regime which is out of the scope of the analysis of our theorems, it is possible that the synchronized frequency could be larger than the maximal frequency of the natural frequencies of all the oscillators. In this article, we also provide numerical experiments to support the analysis of our theorem and to demonstrate the aforementioned phenomenon.


title: Resolution and Betti numbers of Vertex cover ideals

abstract: The vertex cover ideal $J(G)$ of a finite graph $G$ is studied. We characterize when a Cohen--Macaulay vertex cover ideal $J(G)$ has a Scarf minimal free resolution. Furthermore, by using both combinatorial and topological techniques, the graded Betti number $\beta_{i,i+j}(J(G))$, where $i$ and $j$ are the projective dimension and the regularity of $J(G)$, is computed, when $G$ is either a path or a cycle.


title: Study of Curved Domain-wall Fermions on a Lattice

abstract: In this thesis, we consider fermion systems on square lattice spaces with a curved domain-wall mass term. In a similar way to the flat case, we find massless and chiral states localized at the wall. In the case of $S^1$ and $S^2$ domain-wall embedded into a square lattice, we find that these edge states feel gravity through the induced spin connection. In the conventional continuum limit of the higher dimensional lattice, we find a good consistency with the analytic results in the continuum theory. We also confirm that the rotational symmetry is recovered automatically. We also discuss the effect of a $U(1)$ gauge connection on a two-dimensional lattice fermion with the $S^1$ domain-wall mass term. We find that the gauge field changes the eigenvalue spectrum of the boundary system by the Aharanov-Bohm effect and generates an anomaly of the time-reversal ($T$) symmetry. Our numerical evaluation is consistent with the Atiyah-Patodi-Singer index, which describes the cancellation of the $T$ anomaly by the topological term on the bulk system. When we squeeze the flux inside one plaquette while keeping the total flux unchanged, the anomaly inflow undergoes a drastic change. The intense flux gives rise to an additional domain wall around the flux. We observe a novel localized mode at the flux, canceling the $T$ anomaly on the wall instead of the topological term in the bulk. We apply the study to a problem in condensed matter physics. It is known that inside topological insulators, a vortex or monopole acquires a fractional electric charge and turns into a dyon. Describing the topological insulator as a negative mass region of a Dirac fermion, we provide a microscopic description of this phenomenon in terms of the dynamical domain-wall creation.


title: On the Brun--Titchmarsh theorem

abstract: The classical Brun--Titchmarsh theorem gives an upper bound, which is of correct order of magnitude in the full range, for the number of primes $p\leqslant x$ satisfying $p\equiv a\bmod q$. We strength this inequality for $\log q/\log x$ in different ranges, improving upon previous works by Motohashi, Goldfeld, Iwaniec, Friedlander and Iwaniec, and Maynard for general or special moduli. In particular, we obtain a Burgess-like constant in the full range $q<x^{1/2-}.$ The proof is based on various estimates for character and exponential sums, by appealing to arithmetic exponent pairs and bilinear forms with algebraic trace functions from $\ell$-adic cohomology, and sums of Kloosterman sums from spectral theory of automorphic forms, as well as large value theorem for Dirichlet polynomials due to Huxley.


title: Classical modelling of a lossy Gaussian bosonic sampler

abstract: Gaussian boson sampling (GBS) is considered a candidate problem for demonstrating quantum advantage. We propose an algorithm for approximate classical simulation of a lossy GBS instance. The algorithm relies on the Taylor series expansion, and increasing the number of terms of the expansion that are used in the calculation yields greater accuracy. The complexity of the algorithm is polynomial in the number of modes given the number of terms is fixed. We describe conditions for the input state squeezing parameter and loss level that provide the best efficiency for this algorithm (by efficient we mean that the Taylor series converges quickly). In recent experiments that claim to have demonstrated quantum advantage, these conditions are satisfied; thus, this algorithm can be used to classically simulate these experiments.


title: Solitary wave solutions of the delayed KP-BBM equation

abstract: In this paper, we consider a kind of shallow water wave model called the Kadomtsev-Petviashvili-Benjamin-Bona-Mahony (KP-BBM) equation. We firstly consider the unperturbed KP-BBM equation. Then by using the geometric singular perturbation (GSP) theory, especially the invariant manifold theory, method of dynamical system and Melnikov function, the existence of solitary wave solutions of perturbed KP-BBM equation is proved. In other words, we dissuss the equation under different nonlinear terms. Finally, we validate our results with numerical simulations.


title: Transforming the Synthesis of Carbon Nanotubes with Machine Learning Models and Automation

abstract: Carbon-based nanomaterials (CBNs) are showing significant potential in various fields, such as electronics, energy, and mechanics. However, their practical applications face synthesis challenges stemming from the complexities of structural control, large-area uniformity, and high yield. Current research methodologies fall short in addressing the multi-variable, coupled interactions inherent to CBNs production. Machine learning methods excel at navigating such complexities. Their integration with automated synthesis platforms has demonstrated remarkable potential in accelerating chemical synthesis research, but remains underexplored in the nanomaterial domain. Here we introduce Carbon Copilot (CARCO), an artificial intelligence (AI)-driven platform that integrates transformer-based language models tailored for carbon materials, robotic chemical vapor deposition (CVD), and data-driven machine learning models, empowering accelerated research of CBNs synthesis. Employing CARCO, we demonstrate innovative catalyst discovery by predicting a superior Titanium-Platinum bimetallic catalyst for high-density horizontally aligned carbon nanotube (HACNT) array synthesis, validated through over 500 experiments. Furthermore, with the assistance of millions of virtual experiments, we achieved an unprecedented 56.25% precision in synthesizing HACNT arrays with predetermined densities in the real world. All were accomplished within just 43 days. This work not only advances the field of HACNT arrays but also exemplifies the integration of AI with human expertise to overcome the limitations of traditional experimental approaches, marking a paradigm shift in nanomaterials research and paving the way for broader applications.


title: Extraction of Singular Patterns from a Vector Field via Persistent Path Homology

abstract: The extraction of singular patterns is a fundamental problem in theoretical and practical domains due to the ability of such patterns to detect the intrinsic characteristics of vector fields. In this study, we propose an approach for extracting singular patterns from discrete planar vector fields. Our method involves converting the planar discrete vector field into a specialized digraph and computing its one-dimensional persistent path homology. By analyzing the persistence diagram, we can determine the location of singularity and segment a region of the singular pattern, which is referred to as a singular polygon. Moreover, the variations of singular patterns can also be analyzed. The experimental results demonstrate the effectiveness of our method in analyzing the centers and impact areas of tropical cyclones, positioning the dip poles from geomagnetic fields, and measuring variations of singular patterns between vector fields.


title: EEG-SVRec: An EEG Dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation

abstract: In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations when inferring user preferences due to issues such as data sparsity and noise from accidental interactions or personal habits. To address these challenges and provide a more comprehensive understanding of user affective experience and cognitive activity, we propose EEG-SVRec, the first EEG dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation. The study involves 30 participants and collects 3,657 interactions, offering a rich dataset that can be used for a deeper exploration of user preference and cognitive activity. By incorporating selfassessment techniques and real-time, low-cost EEG signals, we offer a more detailed understanding user affective experiences (valence, arousal, immersion, interest, visual and auditory) and the cognitive mechanisms behind their behavior. We establish benchmarks for rating prediction by the recommendation algorithm, showing significant improvement with the inclusion of EEG signals. Furthermore, we demonstrate the potential of this dataset in gaining insights into the affective experience and cognitive activity behind user behaviors in recommender systems. This work presents a novel perspective for enhancing short video recommendation by leveraging the rich information contained in EEG signals and multidimensional affective engagement scores, paving the way for future research in short video recommendation systems.


title: Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languages

abstract: In Indonesia, local languages play an integral role in the culture. However, the available Indonesian language resources still fall into the category of limited data in the Natural Language Processing (NLP) field. This is become problematic when build NLP model for these languages. To address this gap, we introduce Bhinneka Korpus, a multilingual parallel corpus featuring five Indonesian local languages. Our goal is to enhance access and utilization of these resources, extending their reach within the country. We explained in a detail the dataset collection process and associated challenges. Additionally, we experimented with translation task using the IBM Model 1 due to data constraints. The result showed that the performance of each language already shows good indications for further development. Challenges such as lexical variation, smoothing effects, and cross-linguistic variability are discussed. We intend to evaluate the corpus using advanced NLP techniques for low-resource languages, paving the way for multilingual translation models.


title: Membrane Paradigm Approach to the Johannsen-Psaltis Black Hole

abstract: The Johannsen-Psaltis (JP) black hole is a phenomenologically viable metric obtained by judiciously deforming the Kerr black hole such that the metric is asymptotically flat and causal and is consistent with the weak field, post-Newtonian tests of gravity; however, it has additional hairs besides its mass and angular momentum. As it deviates from the Kerr black hole in the strong coupling regime, it is a useful metric to test the Kerr hypothesis that states that all astrophysical black holes are of the Kerr type. Here we give a membrane description of this black hole that effectively amounts to replacing the observable part of the black hole with a fluid with thermal properties. A timelike membrane, a stretched horizon local in time is assumed to exist. This membrane is expected to approximate the null event horizon that is highly non-local in time. We derive the energy-momentum tensor of the fluid and all the transport coefficients using the action formulation to the membrane as advocated by Parikh and Wilczek. In the fluid description, one observes that the finiteness of the transport coefficients constrains the additional hairs of the Johannsen-Psaltis black hole. Analytically continuing the pressure of the fluid to all values of the radial coordinate $r$, one obtains interesting Van der Waals-type behavior of the pressure of the fluid which diverges at the radius of the outer ergosphere, lending support, from the membrane paradigm's perspective to the claim that relativistic astrophysical jets are produced by the ergoregion of the black hole.

categories: gr-qc astro-ph.HE hep-th math-ph math.MP


title: Primitive Recursive Dependent Type Theory

abstract: We show that restricting the elimination principle of the natural numbers type in Martin-L\"of Type Theory (MLTT) to a universe of types not containing $\Pi$-types ensures that all definable functions are primitive recursive. This extends the concept of primitive recursiveness to general types. We discuss extensions to univalent type theories and other notions of computability. We are inspired by earlier work by Martin Hofmann, work on Joyal's arithmetic universes, and Hugo Herbelin and Ludovic Patey's sketched Calculus of Primitive Recursive Constructions. We define a theory Tpr that is a subtheory of MLTT with two universes, such that all inductive types are finitary and the lowest universe is restricted to not contain $\Pi$-types. We prove soundness such that all functions $\mathbb{N}\to\mathbb{N}$ are primitive recursive. The proof requires that Tpr satisfies canonicity, which we easily prove using synthetic Tait computability.


title: Query Performance Prediction using Relevance Judgments Generated by Large Language Models

abstract: Query performance prediction (QPP) aims to estimate the retrieval quality of a search system for a query without human relevance judgments. Previous QPP methods typically return a single scalar value and do not require the predicted values to approximate a specific information retrieval (IR) evaluation measure, leading to certain drawbacks: (i) a single scalar is insufficient to accurately represent different IR evaluation measures, especially when metrics do not highly correlate, and (ii) a single scalar limits the interpretability of QPP methods because solely using a scalar is insufficient to explain QPP results. To address these issues, we propose a QPP framework using automatically generated relevance judgments (QPP-GenRE), which decomposes QPP into independent subtasks of predicting the relevance of each item in a ranked list to a given query. This allows us to predict any IR evaluation measure using the generated relevance judgments as pseudo-labels. This also allows us to interpret predicted IR evaluation measures, and identify, track and rectify errors in generated relevance judgments to improve QPP quality. We predict an item's relevance by using open-source large language models (LLMs) to ensure scientific reproducibility. We face two main challenges: (i) excessive computational costs of judging an entire corpus for predicting a metric considering recall, and (ii) limited performance in prompting open-source LLMs in a zero-/few-shot manner. To solve the challenges, we devise an approximation strategy to predict an IR measure considering recall and propose to fine-tune open-source LLMs using human-labeled relevance judgments. Experiments on the TREC 2019-2022 deep learning tracks show that QPP-GenRE achieves state-of-the-art QPP quality for both lexical and neural rankers.


title: Teeth-SEG: An Efficient Instance Segmentation Framework for Orthodontic Treatment based on Anthropic Prior Knowledge

abstract: Teeth localization, segmentation, and labeling in 2D images have great potential in modern dentistry to enhance dental diagnostics, treatment planning, and population-based studies on oral health. However, general instance segmentation frameworks are incompetent due to 1) the subtle differences between some teeth' shapes (e.g., maxillary first premolar and second premolar), 2) the teeth's position and shape variation across subjects, and 3) the presence of abnormalities in the dentition (e.g., caries and edentulism). To address these problems, we propose a ViT-based framework named TeethSEG, which consists of stacked Multi-Scale Aggregation (MSA) blocks and an Anthropic Prior Knowledge (APK) layer. Specifically, to compose the two modules, we design 1) a unique permutation-based upscaler to ensure high efficiency while establishing clear segmentation boundaries with 2) multi-head self/cross-gating layers to emphasize particular semantics meanwhile maintaining the divergence between token embeddings. Besides, we collect 3) the first open-sourced intraoral image dataset IO150K, which comprises over 150k intraoral photos, and all photos are annotated by orthodontists using a human-machine hybrid algorithm. Experiments on IO150K demonstrate that our TeethSEG outperforms the state-of-the-art segmentation models on dental image segmentation.


title: Harnessing Large Language Models for Training-free Video Anomaly Detection

abstract: Video anomaly detection (VAD) aims to temporally locate abnormal events in a video. Existing works mostly rely on training deep models to learn the distribution of normality with either video-level supervision, one-class supervision, or in an unsupervised setting. Training-based methods are prone to be domain-specific, thus being costly for practical deployment as any domain change will involve data collection and model training. In this paper, we radically depart from previous efforts and propose LAnguage-based VAD (LAVAD), a method tackling VAD in a novel, training-free paradigm, exploiting the capabilities of pre-trained large language models (LLMs) and existing vision-language models (VLMs). We leverage VLM-based captioning models to generate textual descriptions for each frame of any test video. With the textual scene description, we then devise a prompting mechanism to unlock the capability of LLMs in terms of temporal aggregation and anomaly score estimation, turning LLMs into an effective video anomaly detector. We further leverage modality-aligned VLMs and propose effective techniques based on cross-modal similarity for cleaning noisy captions and refining the LLM-based anomaly scores. We evaluate LAVAD on two large datasets featuring real-world surveillance scenarios (UCF-Crime and XD-Violence), showing that it outperforms both unsupervised and one-class methods without requiring any training or data collection.


title: PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison

abstract: Building a reliable and automated evaluation metric is a necessary but challenging problem for open-domain dialogue systems. Recent studies proposed evaluation metrics that assess generated responses by considering their relevance to previous dialogue histories. Although effective, these metrics evaluate individual responses directly rather than considering their relative quality compared to other responses. To handle this, we propose PairEval, a novel dialogue evaluation metric for assessing responses by comparing their quality against responses in different conversations. PairEval is built on top of open-sourced and moderate-size language models, and we make them specialized in pairwise comparison between dialogue responses. Extensive experiments on multiple benchmarks demonstrate that our metric exhibits a higher correlation with human judgments than baseline metrics. We also find that the proposed comparative metric is more robust in detecting common failures from open-domain dialogue systems, including repetition and speaker insensitivity.


title: Numerical modelling of flame spread over thin circular ducts

abstract: This paper presents a numerical investigation into the phenomenon of flame spread over thin circular ducts in normal gravity and microgravity environments. Flame spread over such geometry is of significant interest due to its relevance in various practical applications, including tubes for flow purpose in medical system, fire safety in spacecrafts, ducts as well as wiring tubes. This study comprises of a comprehensive investigation of key parameters affecting flame spread rate, including fuel radius and opposed flow speed in normal gravity and microgravity environments. A 2-D axisymmetric flame spread model accounted for char and numerical simulations were performed which revealed valuable insights into the underlying mechanisms governing flame spread over such geometry. The results computed from the numerical model is compared with the experimentally observed flame spread rate to validate the numerical model which can be used to gain a comprehensive understanding of the underlying physical phenomena. As the radius of circular duct increases the flame spread rate increases both in normal gravity and microgravity environments. The conduction heat feedback and radiation heat gain coming from hot char through gas phase at inner core region are the two major mechanisms which controls the flame spread phenomena over the circular duct fuels. The flame spread rate at different flow ranging from quiescent (0 cm/s) to 30 cm/s is also evaluated and 21 % oxygen and found a non-monotonic increasing decreasing trend of flame spread rate at different opposed flow speed in both normal gravity and microgravity environments.


title: Inequalities for geometric mean distance metric

abstract: We study a hyperbolic type metric $h_{G,c}$ introduced by Dovgoshey, Hariri, and Vuorinen. We find the best constant $c>0$, for which this function $h_{G,c}$ is a metric in specific choices of $G$. We give several sharp inequalities between $h_{G,c}$ and other hyperbolic type metrics, and also offer a few results related to ball inclusion.


title: Accelerate Solving Expensive Scheduling by Leveraging Economical Auxiliary Tasks

abstract: To fully leverage the multi-task optimization paradigm for accelerating the solution of expensive scheduling problems, this study has effectively tackled three vital concerns. The primary issue is identifying auxiliary tasks that closely resemble the original expensive task. We suggested a sampling strategy based on job importance, creating a compact matrix by extracting crucial rows from the entire problem specification matrix of the expensive task. This matrix serves as an economical auxiliary task. Mathematically, we proved that this economical auxiliary task bears similarity to its corresponding expensive task. The subsequent concern revolves around making auxiliary tasks more cost-effective. We determined the sampling proportions for the entire problem specification matrix through factorial design experiments, resulting in a more compact auxiliary task. With a reduced search space and shorter function evaluation time, it can rapidly furnish high-quality transferable information for the primary task. The last aspect involves designing transferable deep information from auxiliary tasks. We regarded the job priorities in the (sub-) optimal solutions to the economical auxiliary task as transferable invariants. By adopting a partial solution patching strategy, we augmented specificity knowledge onto the common knowledge to adapt to the target expensive task. The strategies devised for constructing task pairs and facilitating knowledge transfer, when incorporated into various evolutionary multitasking algorithms, were utilized to address expensive instances of permutation flow shop scheduling. Extensive experiments and statistical comparisons have validated that, with the collaborative synergy of these strategies, the performance of evolutionary multitasking algorithms is significantly enhanced in handling expensive scheduling tasks.


title: Source-Aware Training Enables Knowledge Attribution in Language Models

abstract: Large language models (LLMs) learn a vast amount of knowledge during pretraining, but they are often oblivious to the source(s) of such knowledge. We investigate the problem of intrinsic source citation, where LLMs are required to cite the pretraining source supporting a generated response. Intrinsic source citation can enhance LLM transparency, interpretability, and verifiability. To give LLMs such ability, we explore source-aware training -- a post pretraining recipe that involves (i) training the LLM to associate unique source document identifiers with the knowledge in each document, followed by (ii) an instruction-tuning to teach the LLM to cite a supporting pretraining source when prompted. Source-aware training can easily be applied to pretrained LLMs off the shelf, and diverges minimally from existing pretraining/fine-tuning frameworks. Through experiments on carefully curated data, we demonstrate that our training recipe can enable faithful attribution to the pretraining data without a substantial impact on the model's quality compared to standard pretraining. Our results also highlight the importance of data augmentation in achieving attribution. Code and data available here: \url{https://github.com/mukhal/intrinsic-source-citation}


title: Reversible-to-irreversible transition of colloidal polycrystals under cyclic athermal quasistatic deformation

abstract: Cyclic loading on granular packings and amorphous media exhibits a transition from reversible elastic behavior to irreversible plasticity. The present study compares the irreversibility transition and microscopic details of colloidal polycrystals under oscillatory tensile-compressive and shear strain. Under both modes, the systems exhibit a reversible to irreversible transition. However, the strain amplitude at which the transition is observed is larger in the shear strain than in the tensile-compressive mode. The threshold strain amplitude is confirmed by analyzing the dynamical properties, such as mobility and atomic strain (von-Mises shear strain and the volumetric strain). The structural changes are quantified using a hexatic order parameter. Under both modes of deformation, dislocations and grain boundaries in polycrystals disappear, and monocrystals are formed. We also recognize the dislocation motion through grains. The key difference is that strain accumulates diagonally in oscillatory tensile-compressive deformation, whereas, in shear deformation, strain accumulation is along the $x$ or $y$ axis.


title: Oscillating flow around a circular cylindrical post confined between two parallel plates

abstract: This work is motivated by the interest in determining the effect of the micro-anatomy of the spinal subarachnoid space on the cerebrospinal fluid flow and on the associated transport of solutes. To that aim, we focus on a canonical model problem in which a circular post of radius $a$, confined between two parallel plates separated by a distance $2h$, is subjected to an oscillatory flow. In particular, we are concerned with the steady, viscous, time-averaged flow that persists in the vicinity on the cylinder, when the stroke length of the oscillating flow, $U_{\infty}/\omega$ is smaller or comparable to the radius of the post, $a$, where $U_{\infty}$ and $\omega$ are the mean velocity amplitude and the corresponding angular frequency, respectively. First, we analyze the asymptotic limit of small values of the stroke length varying the aspect ratio of the post $\lambda$ and the Womersley number $M$. First-order steady-streaming corrections at leading order have been computed, together with associated Stokes-drift component, the sum of both yielding the mean Lagrangian velocity field. The confinement effect is seen to induce the three-dimensionality of flow. Moreover, in the mid plane the time-averaged steady flow exhibits a recirculating vortex attached to the wall of the post that decreases as $M$ increases for low values of $M$. However, for values of $M$ larger than a critical one, $M_{cr}(\lambda)$, a second, outer vortex is also formed. The dependence $M_{cr}(\lambda)$ has been quantified. The analysis has been corroborated experimentally for a fixed aspect ratio. Consideration of an anharmonic oscillating flow shows the fort-and-aft symmetry of the steady flow is broken. Finally, the analysis is experimentally extended to consider an array of equally spaced posts.


title: On the Complexity of Minimizing Energy Consumption of Partitioning DAG Tasks

abstract: We study a graph partition problem where we are given a directed acyclic graph (DAG) whose vertices and arcs can be respectively regarded as tasks and dependencies among tasks. The objective of the problem is to minimize the total energy consumed for completing these tasks by assigning the tasks to k heterogeneous machines. We first show that the problem is NP-hard. Then, we present polynomial-time algorithms for two special cases where there are only two machines and where the input DAG is a directed path. Finally, we study a natural variant where there are only two machines with one of them being capable of executing a limited number of tasks. We show that this special case remains computationally hard.


title: Large Language Model Evaluation Via Multi AI Agents: Preliminary results

abstract: As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and potential risks. Despite extensive efforts to examine LLMs from various perspectives, there is a noticeable lack of multi-agent AI models specifically designed to evaluate the performance of different LLMs. To address this gap, we introduce a novel multi-agent AI model that aims to assess and compare the performance of various LLMs. Our model consists of eight distinct AI agents, each responsible for retrieving code based on a common description from different advanced language models, including GPT-3.5, GPT-3.5 Turbo, GPT-4, GPT-4 Turbo, Google Bard, LLAMA, and Hugging Face. Our developed model utilizes the API of each language model to retrieve code for a given high-level description. Additionally, we developed a verification agent, tasked with the critical role of evaluating the code generated by its counterparts. We integrate the HumanEval benchmark into our verification agent to assess the generated code's performance, providing insights into their respective capabilities and efficiencies. Our initial results indicate that the GPT-3.5 Turbo model's performance is comparatively better than the other models. This preliminary analysis serves as a benchmark, comparing their performances side by side. Our future goal is to enhance the evaluation process by incorporating the Massively Multitask Benchmark for Python (MBPP) benchmark, which is expected to further refine our assessment. Additionally, we plan to share our developed model with twenty practitioners from various backgrounds to test our model and collect their feedback for further improvement.


title: AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images

abstract: In recent years, the rapid advancement of Artificial Intelligence Generated Content (AIGC) has attracted widespread attention. Among the AIGC, AI generated omnidirectional images hold significant potential for Virtual Reality (VR) and Augmented Reality (AR) applications, hence omnidirectional AIGC techniques have also been widely studied. AI-generated omnidirectional images exhibit unique distortions compared to natural omnidirectional images, however, there is no dedicated Image Quality Assessment (IQA) criteria for assessing them. This study addresses this gap by establishing a large-scale AI generated omnidirectional image IQA database named AIGCOIQA2024 and constructing a comprehensive benchmark. We first generate 300 omnidirectional images based on 5 AIGC models utilizing 25 text prompts. A subjective IQA experiment is conducted subsequently to assess human visual preferences from three perspectives including quality, comfortability, and correspondence. Finally, we conduct a benchmark experiment to evaluate the performance of state-of-the-art IQA models on our database. The database will be released to facilitate future research.


title: The Grothendieck Construction for $\infty$-Categories Fibered over Categorical Patterns

abstract: We show how to treat families of $\infty$-categories fibered in categorical patterns (e.g., $\infty$-operads and monoidal $\infty$-categories) in terms of fibrations by relativizing the Grothendieck construction. As applications, we construct an analog of the universal cocartesian fibration and explain how to compute limits and colimits of $\infty$-categories fibered in categorical patterns.


title: Modelling Multiplicative Linear Logic via Deep Inference

abstract: Multiplicative linear logic is a very well studied formal system, and most such studies are concerned with the one-sided sequent calculus. In this paper we look in detail at existing translations between a deep inference system and the standard sequent calculus one, provide a simplified translation, and provide a formal proof that a standard approach to modelling is indeed invariant to all these translations. En route we establish a necessary condition for provable sequents related to the number of pars and tensors in a formula that seems to be missing from the literature.


title: Easy-to-configure zero-dimensional valley-chiral modes in a graphene point junction

abstract: The valley degree of freedom in 2D materials can be manipulated for low-dissipation quantum electronics called valleytronics. At the boundary between two regions of bilayer graphene with different atomic or electrostatic configuration, valley-polarized current has been realized. However, the demanding fabrication and operation requirements limit device reproducibility and scalability toward more advanced valleytronics circuits. We demonstrate a new device architecture of a point junction where a valley-chiral 0D PN junction is easily configured, switchable, and capable of carrying valley current with an estimated polarization of ~80%. This work provides a new building block in manipulating valley quantum numbers and scalable valleytronics.


title: The energy-frequency diagram of the (1+1)-dimensional $\Phi^4$ oscillon

abstract: Two different methods are used to study the existence and stability of the (1+1)-dimensional $\Phi^4$ oscillon. The variational technique approximates it by a periodic function with a set of adiabatically changing parameters. An alternative approach treats oscillons as standing waves in a finite-size box; these are sought as solutions of a boundary-value problem on a two-dimensional domain. The numerical analysis reveals that the standing wave's energy-frequency diagram is fragmented into disjoint segments with $\omega_{n-1} < \omega < \omega_{n-2}$, where $\omega_n=\frac{2}{n+1}$. In the interval $(\omega_{n-1}, \omega_{n-2})$, the structure's small-amplitude wings are formed by the $n$-th harmonic radiation ($n=2,3, ...$). All standing waves are practically stable: perturbations may result in the deformation of the wave's radiation wings but do not affect its core. The variational approximation involving the first, zeroth and second harmonic components provides an accurate description of the oscillon with the frequency in $(\omega_1, \omega_0)$, but breaks down as $\omega$ falls out of that interval.


title: Verifying Claims About Metaphors with Large-Scale Automatic Metaphor Identification

abstract: There are several linguistic claims about situations where words are more likely to be used as metaphors. However, few studies have sought to verify such claims with large corpora. This study entails a large-scale, corpus-based analysis of certain existing claims about verb metaphors, by applying metaphor detection to sentences extracted from Common Crawl and using the statistics obtained from the results. The verification results indicate that the direct objects of verbs used as metaphors tend to have lower degrees of concreteness, imageability, and familiarity, and that metaphors are more likely to be used in emotional and subjective sentences.


title: Survey of Bias In Text-to-Image Generation: Definition, Evaluation, and Mitigation

abstract: The recent advancement of large and powerful models with Text-to-Image (T2I) generation abilities -- such as OpenAI's DALLE-3 and Google's Gemini -- enables users to generate high-quality images from textual prompts. However, it has become increasingly evident that even simple prompts could cause T2I models to exhibit conspicuous social bias in generated images. Such bias might lead to both allocational and representational harms in society, further marginalizing minority groups. Noting this problem, a large body of recent works has been dedicated to investigating different dimensions of bias in T2I systems. However, an extensive review of these studies is lacking, hindering a systematic understanding of current progress and research gaps. We present the first extensive survey on bias in T2I generative models. In this survey, we review prior studies on dimensions of bias: Gender, Skintone, and Geo-Culture. Specifically, we discuss how these works define, evaluate, and mitigate different aspects of bias. We found that: (1) while gender and skintone biases are widely studied, geo-cultural bias remains under-explored; (2) most works on gender and skintone bias investigated occupational association, while other aspects are less frequently studied; (3) almost all gender bias works overlook non-binary identities in their studies; (4) evaluation datasets and metrics are scattered, with no unified framework for measuring biases; and (5) current mitigation methods fail to resolve biases comprehensively. Based on current limitations, we point out future research directions that contribute to human-centric definitions, evaluations, and mitigation of biases. We hope to highlight the importance of studying biases in T2I systems, as well as encourage future efforts to holistically understand and tackle biases, building fair and trustworthy T2I technologies for everyone.


title: An $\mathcal{O}$-monoidal Grothendieck construction

abstract: Given an operad $\mathcal{O}$, we define a notion of weak $\mathcal{O}$-monoids -- which we term $\mathcal{O}$-pseudomonoids -- in a 2-category. In the special case with the 2-category in question is the 2-category $\mathsf{Cat}$ of categories, this yields a notion of $\mathcal{O}$-monoidal category, which in the case of the associative and commutative operads retrieves unbiased notions of monoidal and symmetric monoidal categories, respectively. We carefully unpack the definition of $\mathcal{O}$-monoids in the 2-categories of discrete fibrations and of category-indexed sets. Using the classical Grothendieck construction, we thereby obtain an $\mathcal{O}$-monoidal Grothendieck construction relating lax $\mathcal{O}$-monoidal functors into Set to strict $\mathcal{O}$-monoidal functors which are also discrete fibrations.


title: Gelation in input-driven aggregation

abstract: We investigate irreversible aggregation processes driven by a source of small mass clusters. In the spatially homogeneous situation, a well-mixed system is consists of clusters of various masses whose concentrations evolve according to an infinite system of nonlinear ordinary differential equations. We focus on the cluster mass distribution in the long time limit. An input-driven aggregation with rates proportional to the product of merging partners undergoes a percolation transition. We examine this process analytically and numerically. There are two theoretical schemes and two natural ways of numerical integration on the level of a truncated system with a finite number of equations. After the percolation transition, the behavior depends on the adopted approach: The giant component quickly engulfs the entire system (Flory approach), or a non-trivial stationary mass distribution emerges (Stockmayer approach). We also outline generalization to ternary aggregation.

categories: cond-mat.stat-mech cs.NA math.CA math.DS math.NA


title: KazEmoTTS: A Dataset for Kazakh Emotional Text-to-Speech Synthesis

abstract: This study focuses on the creation of the KazEmoTTS dataset, designed for emotional Kazakh text-to-speech (TTS) applications. KazEmoTTS is a collection of 54,760 audio-text pairs, with a total duration of 74.85 hours, featuring 34.23 hours delivered by a female narrator and 40.62 hours by two male narrators. The list of the emotions considered include "neutral", "angry", "happy", "sad", "scared", and "surprised". We also developed a TTS model trained on the KazEmoTTS dataset. Objective and subjective evaluations were employed to assess the quality of synthesized speech, yielding an MCD score within the range of 6.02 to 7.67, alongside a MOS that spanned from 3.51 to 3.57. To facilitate reproducibility and inspire further research, we have made our code, pre-trained model, and dataset accessible in our GitHub repository.


title: Survival of Gas in Subhalos and Its Impact on the 21 cm Forest Signals: Insights from Hydrodynamic Simulations

abstract: Understanding the survival of gas within subhalos under various astrophysical processes is crucial for elucidating cosmic structure formation and evolution. We study the resilience of gas in subhalos, focusing on the impact of tidal and ram pressure stripping through hydrodynamic simulations. Our results uncover significant gas stripping primarily driven by ram pressure effects, which also profoundly influence the gas distribution within these subhalos. Notably, despite their vulnerability to ram pressure effects, the low-mass subhalos can play a pivotal role in influencing the observable characteristics of cosmic structures due to their large abundance. Specifically, we explore the application of our findings to the 21 cm forest, showing how the survival dynamics of gas in subhalos can modulate the 21 cm optical depth, a key probe for detecting minihalos in the pre-reionization era. (abridged) In this work, we further investigate the contribution of subhalos to the 21 cm optical depth with hydrodynamics simulations, particularly highlighting the trajectories and fates of subhalos within mass ranges of \(10^{4-6} M_{\odot}h^{-1}\) in a host halo of \(10^7 M_{\odot}h^{-1}\). Despite their susceptibility to ram pressure stripping, the contribution of abundant low-mass subhalos to the 21-cm optical depth is more significant than that of their massive counterparts primarily due to their greater abundance. We find that the 21-cm optical depth can be increased by a factor of approximately two due to the abundant low-mass subhalos. (abridged) Our work provides critical insights into the gas dynamics within subhalos in the early Universe, highlighting their resilience against environmental stripping effects, and their impact on observable 21-cm signals.


title: MICROSIM: A high performance phase-field solver based on CPU and GPU implementations

abstract: The phase-field method has become a useful tool for the simulation of classical metallurgical phase transformations as well as other phenomena related to materials science. The thermodynamic consistency that forms the basis of these formulations lends to its strong predictive capabilities and utility. However, a strong impediment to the usage of the method for typical applied problems of industrial and academic relevance is the significant overhead with regard to the code development and know-how required for quantitative model formulations. In this paper, we report the development of an open-source phase-field software stack that contains generic formulations for the simulation of multi-phase and multi-component phase transformations. The solvers incorporate thermodynamic coupling that allows the realization of simulations with real alloys in scenarios directly relevant to the materials industry. Further, the solvers utilize parallelization strategies using either multiple CPUs or GPUs to provide cross-platform portability and usability on available supercomputing machines. Finally, the solver stack also contains a graphical user interface to gradually introduce the usage of the software. The user interface also provides a collection of post-processing tools that allow the estimation of useful metrics related to microstructural evolution.


title: Higher education assessment practice in the era of generative AI tools

abstract: The higher education (HE) sector benefits every nation's economy and society at large. However, their contributions are challenged by advanced technologies like generative artificial intelligence (GenAI) tools. In this paper, we provide a comprehensive assessment of GenAI tools towards assessment and pedagogic practice and, subsequently, discuss the potential impacts. This study experimented using three assessment instruments from data science, data analytics, and construction management disciplines. Our findings are two-fold: first, the findings revealed that GenAI tools exhibit subject knowledge, problem-solving, analytical, critical thinking, and presentation skills and thus can limit learning when used unethically. Secondly, the design of the assessment of certain disciplines revealed the limitations of the GenAI tools. Based on our findings, we made recommendations on how AI tools can be utilised for teaching and learning in HE.


title: ARAGOG: Advanced RAG Output Grading

abstract: Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and comparisons of new state-of-the-art (SoTA) techniques against their predecessors, with a gap in extensive experimental comparisons. This study begins to address this gap by assessing various RAG methods' impacts on retrieval precision and answer similarity. We found that Hypothetical Document Embedding (HyDE) and LLM reranking significantly enhance retrieval precision. However, Maximal Marginal Relevance (MMR) and Cohere rerank did not exhibit notable advantages over a baseline Naive RAG system, and Multi-query approaches underperformed. Sentence Window Retrieval emerged as the most effective for retrieval precision, despite its variable performance on answer similarity. The study confirms the potential of the Document Summary Index as a competent retrieval approach. All resources related to this research are publicly accessible for further investigation through our GitHub repository ARAGOG (https://github.com/predlico/ARAGOG). We welcome the community to further this exploratory study in RAG systems.


title: The split 5-Casimir operator and the structure of $\wedge \mathfrak{ad}^{\otimes 5}$

abstract: In the present paper, using the split Casimir operators we have found the decomposition of the antisymmetric part of $\mathfrak{ad}^{\otimes 5}$. This decomposition contains the representations that appeared in the decomposition of $\mathfrak{ad}^{\otimes 4}$ and only one new representation $X_5$. The dimension of this representation has been proposed in [A.J.Macfarlane, H.Pfeiffer, J.Phys.A: Math. Gen. 36 (2003) 2305]. Our decomposition is valid for all Lie algebras.


title: A Survey on Hypergraph Neural Networks: An In-Depth and Step-By-Step Guide

abstract: Higher-order interactions (HOIs) are ubiquitous in real-world complex systems and applications, and thus investigation of deep learning for HOIs has become a valuable agenda for the data mining and machine learning communities. As networks of HOIs are expressed mathematically as hypergraphs, hypergraph neural networks (HNNs) have emerged as a powerful tool for representation learning on hypergraphs. Given the emerging trend, we present the first survey dedicated to HNNs, with an in-depth and step-by-step guide. Broadly, the present survey overviews HNN architectures, training strategies, and applications. First, we break existing HNNs down into four design components: (i) input features, (ii) input structures, (iii) message-passing schemes, and (iv) training strategies. Second, we examine how HNNs address and learn HOIs with each of their components. Third, we overview the recent applications of HNNs in recommendation, biological and medical science, time series analysis, and computer vision. Lastly, we conclude with a discussion on limitations and future directions.


title: Monge-Amp\`ere equations with right-hand sides of polynomial growth

abstract: We study the regularity and the growth rates of solutions to two-dimensional Monge-Amp\`ere equations with the right-hand side exhibiting polynomial growth. Utilizing this analysis, we demonstrate that the translators for the flow by sub-affine-critical powers of the Gauss curvature are smooth, strictly convex entire graphs. These graphs exhibit specific growth rates that depend solely on the power of the flow.


title: Can LLMs get help from other LLMs without revealing private information?

abstract: Cascades are a common type of machine learning systems in which a large, remote model can be queried if a local model is not able to accurately label a user's data by itself. Serving stacks for large language models (LLMs) increasingly use cascades due to their ability to preserve task performance while dramatically reducing inference costs. However, applying cascade systems in situations where the local model has access to sensitive data constitutes a significant privacy risk for users since such data could be forwarded to the remote model. In this work, we show the feasibility of applying cascade systems in such setups by equipping the local model with privacy-preserving techniques that reduce the risk of leaking private information when querying the remote model. To quantify information leakage in such setups, we introduce two privacy measures. We then propose a system that leverages the recently introduced social learning paradigm in which LLMs collaboratively learn from each other by exchanging natural language. Using this paradigm, we demonstrate on several datasets that our methods minimize the privacy loss while at the same time improving task performance compared to a non-cascade baseline.


title: Multiplicative Hecke operators and their applications

abstract: In this paper, we define the multiplicative Hecke operators $\mathcal{T}(n)$ for any positive integer on the integral weight meromorphic modular forms for $\Gamma_{0}(N)$. We then show that they have properties similar to those of additive Hecke operators. Moreover, we prove that multiplicative Hecke eigenforms with integer Fourier coefficients are eta quotients, and vice versa. In addition, we prove that the Borcherds product and logarithmic derivative are Hecke equivariant with the multiplicative Hecke operators and the Hecke operators on the half-integral weight harmonic weak Maass forms and weight 2 meromorphic modular forms.


title: The Mean Shape under the Relative Curvature Condition

abstract: The relative curvature condition (RCC) serves as a crucial constraint, ensuring the avoidance of self-intersection problems in calculating the mean shape over a sample of swept regions. By considering the RCC, this work discusses estimating the mean shape for a class of swept regions called elliptical slabular objects based on a novel shape representation, namely elliptical tube representation (ETRep). The ETRep shape space equipped with extrinsic and intrinsic distances in accordance with object transformation is explained. The intrinsic distance is determined based on the intrinsic skeletal coordinate system of the shape space. Further, calculating the intrinsic mean shape based on the intrinsic distance over a set of ETReps is demonstrated. The proposed intrinsic methodology is applied for the statistical shape analysis to design global and partial hypothesis testing methods to study the hippocampal structure in early Parkinson's disease.


title: Discovery of thionylimide, HNSO, in space: the first N-, S- and O-bearing interstellar molecule

abstract: We present the first detection in space of thionylimide (HNSO) toward the Galactic Center molecular cloud G+0.693-0.027, thanks to the superb sensitivity of an ultradeep molecular line survey carried out with the Yebes 40$\,$m and IRAM 30$\,$m telescopes. This molecule is the first species detected in the interstellar medium containing, simultaneously, N, S and O. We have identified numerous $K$$_a$ = 0, 1 and 2 transitions belonging to HNSO covering from $J$$_{\rm up}$ = 2 to $J$$_{\rm up}$ = 10, including several completely unblended features. We derive a molecular column density of $N$ = (8 $\pm$ 1)$\times$10$^{13}$ cm$^{-2}$, yielding a fractional abundance relative to H$_2$ of $\sim$6$\times$10$^{-10}$, which is about $\sim$37 and $\sim$4.8 times less abundant than SO and SO2, respectively. Although there are still many unknowns in the interstellar chemistry of NSO-bearing molecules, we propose that HNSO is likely formed through the reaction of the NSO radical and atomic H on the surface of icy grains, with alternative routes also deserving exploration. Finally, HNSO appears as a promising link between N- , S- and O- interstellar chemistry and its discovery paves the route to the detection of a new family of molecules in space.


title: On the distribution of $\alpha p^2+\beta$ modulo one for primes $p$ such that $p+2$ has no more two prime divisors

abstract: A classical problem in analytic number theory is to study the distribution of fractional part $\alpha p^k+\beta,\,k\ge 1$ modulo 1, where $\alpha$ is irrational and $p$ runs over the set of primes. For $k=2$ we consider the subsequence generated by the primes $p$ such that $p+2$ is an almost-prime (the existence of infinitely many such $p$ is another topical result in prime number theory) and prove that its distribution has a similar property.


title: Locating influential nodes in hypergraphs via fuzzy collective influence

abstract: Complex contagion phenomena, such as the spread of information or contagious diseases, often occur among the population due to higher-order interactions between individuals. Individuals who can be represented by nodes in a network may play different roles in the spreading process, and thus finding the most influential nodes in a network has become a crucial topic in network science for applications such as viral marketing, rumor suppression, and disease control. To solve the problem of identifying nodes that have high influence in a complex system, we propose a higher-order distance-based fuzzy centrality methods (HDF and EHDF) that are customized for a hypergraph which can characterize higher-order interactions between nodes via hyperedges. The methods we proposed assume that the influence of a node is reliant on the neighboring nodes with a certain higher-order distance. We compare the proposed methods with the baseline centrality methods to verify their effectiveness. Experimental results on six empirical hypergraphs show that the proposed methods could better identify influential nodes, especially showing plausible performance in finding the top influential nodes. Our proposed theoretical framework for identifying influential nodes could provide insights into how higher-order topological structure can be used for tasks such as vital node identification, influence maximization, and network dismantling.


title: On the distribution of $\alpha p+\beta$ modulo one for primes of type $p=ar^2+1$

abstract: A classical problem in analytic number theory is to study the distribution of fractional part $\alpha p+\beta$ modulo 1, where $\alpha$ is irrational and $p$ runs over the set of primes. We consider the subsequence generated by the primes $p$ such that $p=ar^2+1$ and prove that its distribution has a similar property.


title: Some mathematical and geometrical interpretations of the Sator Square

abstract: In 1738, the King of Naples and future King of Spain, Carlos III, commissioned the Spanish military engineer Roque Joaqu\'in de Alcubierre to begin the excavations of the ruins of the ancient Roman city of Pompeii and its surroundings, buried by the terrible explosion of Vesuvius in AD 79. Since that time, archaeologists have brought to light wonderful treasures found in the among ruins. Among them, the Sator Square is one of the most peculiar, apparently simple but mysterious. Supernatural and medicinal powers have been attributed to this object and its use was widespread during the Middle Age. Studies to explain its origin and meaning have been varied. There are theories that relate it to religion, the occult, medicine and music. However, no explanation has been convincing beyond pseudo-scientific sensationalism. In this study, the author intends to eliminate the mystical character of the Sator Square and suggests considering it as a simple palindrome or a game of words with certain symmetrical properties. However, these properties are not exclusive to the Sator Suare but are present in various mathematical and geometric objects.


title: A Novel Sector-Based Algorithm for an Optimized Star-Galaxy Classification

abstract: This paper introduces a novel sector-based methodology for star-galaxy classification, leveraging the latest Sloan Digital Sky Survey data (SDSS-DR18). By strategically segmenting the sky into sectors aligned with SDSS observational patterns and employing a dedicated convolutional neural network (CNN), we achieve state-of-the-art performance for star galaxy classification. Our preliminary results demonstrate a promising pathway for efficient and precise astronomical analysis, especially in real-time observational settings.


title: Drag Your Noise: Interactive Point-based Editing via Diffusion Semantic Propagation

abstract: Point-based interactive editing serves as an essential tool to complement the controllability of existing generative models. A concurrent work, DragDiffusion, updates the diffusion latent map in response to user inputs, causing global latent map alterations. This results in imprecise preservation of the original content and unsuccessful editing due to gradient vanishing. In contrast, we present DragNoise, offering robust and accelerated editing without retracing the latent map. The core rationale of DragNoise lies in utilizing the predicted noise output of each U-Net as a semantic editor. This approach is grounded in two critical observations: firstly, the bottleneck features of U-Net inherently possess semantically rich features ideal for interactive editing; secondly, high-level semantics, established early in the denoising process, show minimal variation in subsequent stages. Leveraging these insights, DragNoise edits diffusion semantics in a single denoising step and efficiently propagates these changes, ensuring stability and efficiency in diffusion editing. Comparative experiments reveal that DragNoise achieves superior control and semantic retention, reducing the optimization time by over 50% compared to DragDiffusion. Our codes are available at https://github.com/haofengl/DragNoise.


title: Action Detection via an Image Diffusion Process

abstract: Action detection aims to localize the starting and ending points of action instances in untrimmed videos, and predict the classes of those instances. In this paper, we make the observation that the outputs of the action detection task can be formulated as images. Thus, from a novel perspective, we tackle action detection via a three-image generation process to generate starting point, ending point and action-class predictions as images via our proposed Action Detection Image Diffusion (ADI-Diff) framework. Furthermore, since our images differ from natural images and exhibit special properties, we further explore a Discrete Action-Detection Diffusion Process and a Row-Column Transformer design to better handle their processing. Our ADI-Diff framework achieves state-of-the-art results on two widely-used datasets.


title: Hofer Energy and Link Preserving Diffeomorphisms in Higher Genus

abstract: Given a pre-monotone Lagrangian link, we obtain Hofer energy estimates for Hamiltonian diffeomorphisms preserving it. Such estimates depend on the braid type of the Hamiltonian diffeomorphism only, and the natural language to talk about this phenomenon is provided by a family of norms on braid groups for surfaces with boundary. This generalises the results obtained by the first author to higher genus surfaces with boundary.


title: HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior

abstract: We present HAHA - a novel approach for animatable human avatar generation from monocular input videos. The proposed method relies on learning the trade-off between the use of Gaussian splatting and a textured mesh for efficient and high fidelity rendering. We demonstrate its efficiency to animate and render full-body human avatars controlled via the SMPL-X parametric model. Our model learns to apply Gaussian splatting only in areas of the SMPL-X mesh where it is necessary, like hair and out-of-mesh clothing. This results in a minimal number of Gaussians being used to represent the full avatar, and reduced rendering artifacts. This allows us to handle the animation of small body parts such as fingers that are traditionally disregarded. We demonstrate the effectiveness of our approach on two open datasets: SnapshotPeople and X-Humans. Our method demonstrates on par reconstruction quality to the state-of-the-art on SnapshotPeople, while using less than a third of Gaussians. HAHA outperforms previous state-of-the-art on novel poses from X-Humans both quantitatively and qualitatively.


title: Regularized Best-of-N Sampling to Mitigate Reward Hacking for Language Model Alignment

abstract: Best-of-N (BoN) sampling with a reward model has been shown to be an effective strategy for aligning Large Language Models (LLMs) to human preferences at the time of decoding. BoN sampling is susceptible to a problem known as reward hacking. Because the reward model is an imperfect proxy for the true objective, over-optimizing its value can compromise its performance on the true objective. A common solution to prevent reward hacking in preference learning techniques is to optimize a reward using proximity regularization (e.g., KL regularization), which ensures that the language model remains close to the reference model. In this research, we propose Regularized Best-of-N (RBoN), a variant of BoN that aims to mitigate reward hacking by incorporating a proximity term in response selection, similar to preference learning techniques. We evaluate RBoN on the AlpacaFarm and Anthropic's hh-rlhf datasets and find that it outperforms BoN. As an application of RBoN, we use RBoN to generate a pairwise preference learning dataset. Experimental results show that a DPO model trained on a dataset generated with RBoN outperforms a DPO model generated with vanilla BoN. Our code is available at https://github.com/CyberAgentAILab/regularized-bon


title: Quantum circuit scheduler for QPUs usage optimization

abstract: Progress in the realm of quantum technologies is paving the way for a multitude of potential applications across different sectors. However, the reduced number of available quantum computers, their technical limitations and the high demand for their use are posing some problems for developers and researchers. Mainly, users trying to execute quantum circuits on these devices are usually facing long waiting times in the tasks queues. In this context, this work propose a technique to reduce waiting times and optimize quantum computers usage by scheduling circuits from different users into combined circuits that are executed at the same time. To validate this proposal, different widely known quantum algorithms have been selected and executed in combined circuits. The obtained results are then compared with the results of executing the same algorithms in an isolated way. This allowed us to measure the impact of the use of the scheduler. Among the obtained results, it has been possible to verify that the noise suffered by executing a combination of circuits through the proposed scheduler does not critically affect the outcomes.


title: Detangling the quantum tapestry of intra-channel interference in below-threshold nonsequential double ionization with few-cycle laser pulses

abstract: We perform a systematic analysis of single-channel quantum interference in laser-induced nonsequential double ionization with few-cycle pulses, using the strong-field approximation. We focus on a below-threshold intensity for which the recollision-excitation with subsequent ionization (RESI) mechanism is prevalent. We derive and classify several analytic interference conditions for single-channel RESI in arbitrary driving fields, and address specific issues for few-cycle pulses. Since the cycles in a short pulse are no longer equivalent, there are several events whose dominance varies. We quantify this dominance for single excitation channels by proposing a dominance parameter. Moreover, there will be many more types of superimposed interference fringes that must be taken into consideration. We find an intricate tapestry of patterns arising from phase differences related to symmetrization, temporal shifts and a combination of exchange and event interference.


title: Larger Nearly Orthogonal Sets over Finite Fields

abstract: For a field $\mathbb{F}$ and integers $d$ and $k$, a set ${\cal A} \subseteq \mathbb{F}^d$ is called $k$-nearly orthogonal if its members are non-self-orthogonal and every $k+1$ vectors of ${\cal A}$ include an orthogonal pair. We prove that for every prime $p$ there exists some $\delta = \delta(p)>0$, such that for every field $\mathbb{F}$ of characteristic $p$ and for all integers $k \geq 2$ and $d \geq k$, there exists a $k$-nearly orthogonal set of at least $d^{\delta \cdot k/\log k}$ vectors of $\mathbb{F}^d$. The size of the set is optimal up to the $\log k$ term in the exponent. We further prove two extensions of this result. In the first, we provide a large set ${\cal A}$ of non-self-orthogonal vectors of $\mathbb{F}^d$ such that for every two subsets of ${\cal A}$ of size $k+1$ each, some vector of one of the subsets is orthogonal to some vector of the other. In the second extension, every $k+1$ vectors of the produced set ${\cal A}$ include $\ell+1$ pairwise orthogonal vectors for an arbitrary fixed integer $1 \leq \ell \leq k$. The proofs involve probabilistic and spectral arguments and the hypergraph container method.


title: A Novel Audio Representation for Music Genre Identification in MIR

abstract: For Music Information Retrieval downstream tasks, the most common audio representation is time-frequency-based, such as Mel spectrograms. In order to identify musical genres, this study explores the possibilities of a new form of audio representation one of the most usual MIR downstream tasks. Therefore, to discretely encoding music using deep vector quantization; a novel audio representation was created for the innovative generative music model i.e. Jukebox. The effectiveness of Jukebox's audio representation is compared to Mel spectrograms using a dataset that is almost equivalent to State-of-the-Art (SOTA) and an almost same transformer design. The results of this study imply that, at least when the transformers are pretrained using a very modest dataset of 20k tracks, Jukebox's audio representation is not superior to Mel spectrograms. This could be explained by the fact that Jukebox's audio representation does not sufficiently take into account the peculiarities of human hearing perception. On the other hand, Mel spectrograms are specifically created with the human auditory sense in mind.


title: STAR-RIS Aided Secure MIMO Communication Systems

abstract: This paper investigates simultaneous transmission and reflection reconfigurable intelligent surface (STAR-RIS) aided physical layer security (PLS) in multiple-input multiple-output (MIMO) systems, where the base station (BS) transmits secrecy information with the aid of STAR-RIS against multiple eavesdroppers equipped with multiple antennas. We aim to maximize the secrecy rate by jointly optimizing the active beamforming at the BS and passive beamforming at the STAR-RIS, subject to the hardware constraint for STAR-RIS. To handle the coupling variables, a minimum mean-square error (MMSE) based alternating optimization (AO) algorithm is applied. In particular, the amplitudes and phases of STAR-RIS are divided into two blocks to simplify the algorithm design. Besides, by applying the Majorization-Minimization (MM) method, we derive a closed-form expression of the STAR-RIS's phase shifts. Numerical results show that the proposed scheme significantly outperforms various benchmark schemes, especially as the number of STAR-RIS elements increases.


title: A comparison of Single- and Double-generator formalisms for Thermodynamics-Informed Neural Networks

abstract: The development of inductive biases has been shown to be a very effective way to increase the accuracy and robustness of neural networks, particularly when they are used to predict physical phenomena. These biases significantly increase the certainty of predictions, decrease the error made and allow considerably smaller datasets to be used. There are a multitude of methods in the literature to develop these biases. One of the most effective ways, when dealing with physical phenomena, is to introduce physical principles of recognised validity into the network architecture. The problem becomes more complex without knowledge of the physical principles governing the phenomena under study. A very interesting possibility then is to turn to the principles of thermodynamics, which are universally valid, regardless of the level of abstraction of the description sought for the phenomenon under study. To ensure compliance with the principles of thermodynamics, there are formulations that have a long tradition in many branches of science. In the field of rheology, for example, two main types of formalisms are used to ensure compliance with these principles: one-generator and two-generator formalisms. In this paper we study the advantages and disadvantages of each, using classical problems with known solutions and synthetic data.


title: Wiedemann-Franz law violation domain for graphene and nonrelativistic systems

abstract: Systematic and comparative research on Lorenz ratios for graphene and nonrelativistic systems has been studied to identify their Wiedemann-Franz law violation domain. Fermi energy and temperature are the main governing parameters for deciding the values of the Lorenz ratio, which is basically thermal conductivity divided by electrical conductivity times temperature times Lorenz number. Metals as three-dimensional nonrelativistic electron gas locate at higher Fermi-energy by temperature domain, where Lorenz ratio remains one. Hence, they obey the Wiedemann-Franz law. By creating higher doping in a two-dimensional graphene system, one can again reach a higher Fermi-energy by temperature domain and get a constant Lorenz ratio. For both graphene and non-relativistic systems, the Lorenz ratio goes below one if we go lower Fermi-energy by temperature domain, which is possible for the graphene system by decreasing the doping concentration. Experimentally observed greater than one Lorenz ratio in this lower Fermi-energy by temperature domain or Dirac Fluid domain indicates that non-fluid expressions of Lorenz ratio should be replaced by fluid-type expressions. We have noticed a divergent trend of Lorenz ratio in the Dirac Fluid domain using its fluid-type expression, and it matches with the trend of experimental data.


title: Multiple Modes of Motion for the Effectiveness of Outer Hair Cells at High Frequencies

abstract: Outer hair cells (OHCs) are essential for the sensitivity and frequency specificity of the mammalian ear. To perform this function, OHCs need to amplify the motion of the basilar membrane (BM), which is much stiffer than themselves. If OHCs and the BM are components of a single oscillator, this impedance mismatch seriously limits the effectiveness of OHCs. However, the elaborated structure of the organ of Corti can support multiple modes motion. Here, systems of two coupled oscillators are examined as the simplest models of the system with multiple modes of motion. It is found that some of these model systems have conditions, under which an OHC can function as an effective amplifier, overcoming the impedance mismatch. The present examination suggests that the presence of multiple modes of motion is a key to the exquisite performance of the mammalian ear.


title: Chat Modeling: Natural Language-based Procedural Modeling of Biological Structures without Training

abstract: 3D modeling of biological structures is an inherently complex process, necessitating both biological and geometric understanding. Additionally, the complexity of user interfaces of 3D modeling tools and the associated steep learning curve further exacerbate the difficulty of authoring a 3D model. In this paper, we introduce a novel framework to address the challenge of using 3D modeling software by converting users' textual inputs into modeling actions within an interactive procedural modeling system. The framework incorporates a code generator of a novel code format and a corresponding code interpreter. The major technical innovation includes the user-refinement mechanism that captures the degree of user dissatisfaction with the modeling outcome, offers an interactive revision, and leverages this feedback for future improved 3D modeling. This entire framework is powered by large language models and eliminates the need for a traditional training process. We develop a prototype tool named Chat Modeling, offering both automatic and step-by-step 3D modeling approaches. Our evaluation of the framework with structural biologists highlights the potential of our approach being utilized in their scientific workflows. All supplemental materials are available at https://osf.io/x4qb7/.


title: Roadside Monocular 3D Detection via 2D Detection Prompting

abstract: The problem of roadside monocular 3D detection requires detecting objects of interested classes in a 2D RGB frame and predicting their 3D information such as locations in bird's-eye-view (BEV). It has broad applications in traffic control, vehicle-vehicle communication, and vehicle-infrastructure cooperative perception. To approach this problem, we present a novel and simple method by prompting the 3D detector using 2D detections. Our method builds on a key insight that, compared with 3D detectors, a 2D detector is much easier to train and performs significantly better w.r.t detections on the 2D image plane. That said, one can exploit 2D detections of a well-trained 2D detector as prompts to a 3D detector, being trained in a way of inflating such 2D detections to 3D towards 3D detection. To construct better prompts using the 2D detector, we explore three techniques: (a) concatenating both 2D and 3D detectors' features, (b) attentively fusing 2D and 3D detectors' features, and (c) encoding predicted 2D boxes x, y, width, height, label and attentively fusing such with the 3D detector's features. Surprisingly, the third performs the best. Moreover, we present a yaw tuning tactic and a class-grouping strategy that merges classes based on their functionality; these techniques improve 3D detection performance further. Comprehensive ablation studies and extensive experiments demonstrate that our method resoundingly outperforms prior works, achieving the state-of-the-art on two large-scale roadside 3D detection benchmarks.


title: T-Mamba: Frequency-Enhanced Gated Long-Range Dependency for Tooth 3D CBCT Segmentation

abstract: Efficient tooth segmentation in three-dimensional (3D) imaging, critical for orthodontic diagnosis, remains challenging due to noise, low contrast, and artifacts in CBCT images. Both convolutional Neural Networks (CNNs) and transformers have emerged as popular architectures for image segmentation. However, their efficacy in handling long-range dependencies is limited due to inherent locality or computational complexity. To address this issue, we propose T-Mamba, integrating shared positional encoding and frequency-based features into vision mamba, to address limitations in spatial position preservation and feature enhancement in frequency domain. Besides, we also design a gate selection unit to integrate two features in spatial domain and one feature in frequency domain adaptively. T-Mamba is the first work to introduce frequency-based features into vision mamba. Extensive experiments demonstrate that T-Mamba achieves new SOTA results on the public Tooth CBCT dataset and outperforms previous SOTA methods by a large margin, i.e., IoU + 3.63%, SO + 2.43%, DSC +2.30%, HD -4.39mm, and ASSD -0.37mm. The code and models are publicly available at https://github.com/isbrycee/T-Mamba.


title: Steering game dynamics towards desired outcomes

abstract: The dynamic behavior of agents in games, which captures how their strategies evolve over time based on past interactions, can lead to a spectrum of undesirable behaviors, ranging from non-convergence to Nash equilibria to the emergence of limit cycles and chaos. To mitigate the effects of selfish behavior, central planners can use dynamic payments to guide strategic multi-agent systems toward stability and socially optimal outcomes. However, the effectiveness of such interventions critically relies on accurately predicting agents' responses to incentives and dynamically adjusting payments so that the system is guided towards the desired outcomes. These challenges are further amplified in real-time applications where the dynamics are unknown and only scarce data is available. To tackle this challenge, in this work we introduce the SIAR-MPC method, combining the recently introduced Side Information Assisted Regression (SIAR) method for system identification with Model Predictive Control (MPC). SIAR utilizes side-information constraints inherent to game theoretic applications to model agent responses to payments from scarce data, while MPC uses this model to facilitate dynamic payment adjustments. Our experiments demonstrate the efficiency of SIAR-MPC in guiding the system towards socially optimal equilibria, stabilizing chaotic behaviors, and avoiding specified regions of the state space. Comparative analyses in data-scarce settings show SIAR-MPC's superior performance over pairing MPC with Physics Informed Neural Networks (PINNs), a powerful system identification method that finds models satisfying specific constraints.


title: Exploring the Mystery of Influential Data for Mathematical Reasoning

abstract: Selecting influential data for fine-tuning on downstream tasks is a key factor for both performance and computation efficiency. Recent works have shown that training with only limited data can show a superior performance on general tasks. However, the feasibility on mathematical reasoning tasks has not been validated. To go further, there exist two open questions for mathematical reasoning: how to select influential data and what is an influential data composition. For the former one, we propose a Quality-aware Diverse Selection (QaDS) strategy adaptable for mathematical reasoning. A comparison with other selection strategies validates the superiority of QaDS. For the latter one, we first enlarge our setting and explore the influential data composition. We conduct a series of experiments and highlight: scaling up reasoning data, and training with general data selected by QaDS is helpful. Then, we define our optimal mixture as OpenMathMix, an influential data mixture with open-source data selected by QaDS. With OpenMathMix, we achieve a state-of-the-art 48.8% accuracy on MATH with 7B base model. Additionally, we showcase the use of QaDS in creating efficient fine-tuning mixtures with various selection ratios, and analyze the quality of a wide range of open-source datasets, which can perform as a reference for future works on mathematical reasoning tasks.


title: Dual-Unitary Classical Shadow Tomography

abstract: We introduce a classical shadow tomography scheme based on dual-unitary brick-wall circuits termed "dual-unitary shadow tomography" (DUST). For this we study operator spreading and Pauli weight dynamics in one-dimensional qubit systems, evolved by random two-local dual-unitary gates arranged in a brick-wall structure, ending with a final measurement layer. We do this by deriving general constraints on the Pauli weight transfer matrix and specializing to the case of dual-unitarity. We first show that dual-unitaries must have a minimal amount of entropy production. Remarkably, we find that operator spreading in these circuits have a rich structure resembling that of relativistic quantum field theories, with massless chiral excitations that can decay or fuse into each other, which we call left- or right-movers. We develop a mean-field description of the Pauli weight in terms of $\rho(x,t)$, which represents the probability of having nontrivial support at site $x$ and depth $t$ starting from a fixed weight distribution. We develop an equation of state for $\rho(x,t)$, and simulate it numerically using Monte Carlo simulations. Lastly, we demonstrate that the fast-thermalizing properties of dual-unitary circuits make them better at predicting large operators than shallow brick-wall Clifford circuits. Our results are robust to finite-size effects due to the chirality of dual-unitary brick-wall circuits.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech math-ph math.MP


title: Distribution of sums of square roots modulo $1$

abstract: We improve upon a result of Steinerberger (2024) by demonstrating that for any fixed $k \in \mathbb{N}$ and sufficiently large $n$, there exist integers $1 \leq a_1, \dots, a_k \leq n$ satisfying: \begin{align*} 0 < \left\| \sum_{j=1}^{k} \sqrt{a_j} \right\| = O(n^{-k/2}). \end{align*} The exponent $k/2$ improves upon the previous exponent of $c k^{1/3}$ of Steinerberger (2024), where $c>0$ is an absolute constant. We also show that for $\alpha \in \mathbb{R}$, there exist integers $1 \leq b_1, \dots, b_k \leq n$ such that: \begin{align*} \left\| \sum_{j=1}^k \sqrt{b_j} - \alpha \right\| = O(n^{-\gamma_k}), \end{align*} where $\gamma_k \geq \frac{k-1}{4}$ and $\gamma_k = k/2$ when $k=2^m - 1$, $m=1,2,\dots$. Importantly, our approach avoids the use of exponential sums.


title: Advancing AI with Integrity: Ethical Challenges and Solutions in Neural Machine Translation

abstract: This paper addresses the ethical challenges of Artificial Intelligence in Neural Machine Translation (NMT) systems, emphasizing the imperative for developers to ensure fairness and cultural sensitivity. We investigate the ethical competence of AI models in NMT, examining the Ethical considerations at each stage of NMT development, including data handling, privacy, data ownership, and consent. We identify and address ethical issues through empirical studies. These include employing Transformer models for Luganda-English translations and enhancing efficiency with sentence mini-batching. And complementary studies that refine data labeling techniques and fine-tune BERT and Longformer models for analyzing Luganda and English social media content. Our second approach is a literature review from databases such as Google Scholar and platforms like GitHub. Additionally, the paper probes the distribution of responsibility between AI systems and humans, underscoring the essential role of human oversight in upholding NMT ethical standards. Incorporating a biblical perspective, we discuss the societal impact of NMT and the broader ethical responsibilities of developers, positing them as stewards accountable for the societal repercussions of their creations.


title: Machine Learning in High Energy Physics: A review of heavy-flavor jet tagging at the LHC

abstract: The application of machine learning (ML) in high energy physics (HEP), specifically in heavy-flavor jet tagging at Large Hadron Collider (LHC) experiments, has experienced remarkable growth and innovation in the past decade. This review provides a detailed examination of current and past ML techniques in this domain. It starts by exploring various data representation methods and ML architectures, encompassing traditional ML algorithms and advanced deep learning techniques. Subsequent sections discuss specific instances of successful ML applications in jet flavor tagging in the ATLAS and CMS experiments at the LHC, ranging from basic fully-connected layers to graph neural networks employing attention mechanisms. To systematically categorize the advancements over the LHC's three runs, the paper classifies jet tagging algorithms into three generations, each characterized by specific data representation techniques and ML architectures. This classification aims to provide an overview of the chronological evolution in this field. Finally, a brief discussion about anticipated future developments and potential research directions in the field is presented.