title: Semitopology: distributed collaborative action via topology, algebra, and logic

abstract: We introduce semitopologies, a generalisation of point-set topology that removes the restriction that intersections of open sets need necessarily be open. The intuition is that points are participants in some distributed system, and an open set is a collection of participants that can collaborate to update their local state by taking a distributed collaborative action; we call this an actionable coalition. What constitutes an actionable coalition depends on what actions we want to model. Intuitive examples include 'a group of people that is collectively strong enough to lift a rock', where the state update is very simply 'holding rock low' to 'holding rock high' and this update is common to all participants in the actionable coalition. Or, consider 'two people wishing to barter a can of juice for a bar of chocolate', in which case the coalition is any such pair and the state updates differ between participants to flip them between 'has/has no juice' and 'has/has no chocolate'. A characteristic of these systems is that state updates are local to the coalition, voluntary, may vary between participants, and are not assumed subject to permission or synchronisation by a central authority. Peer-to-peer computer networks, including filesharing and blockchain systems, provide motivating examples from computing. This monograph presents a comprehensive view of semitopologies which includes point-set semitopology, algebra, and logic inspired by these considerations. This is interesting in and of itself and it provides a conceptual framework within which to understand a useful class of distributed systems.


title: Minimum Description Length and Generalization Guarantees for Representation Learning

abstract: A major challenge in designing efficient statistical supervised learning algorithms is finding representations that perform well not only on available training samples but also on unseen data. While the study of representation learning has spurred much interest, most existing such approaches are heuristic; and very little is known about theoretical generalization guarantees. In this paper, we establish a compressibility framework that allows us to derive upper bounds on the generalization error of a representation learning algorithm in terms of the "Minimum Description Length" (MDL) of the labels or the latent variables (representations). Rather than the mutual information between the encoder's input and the representation, which is often believed to reflect the algorithm's generalization capability in the related literature but in fact, falls short of doing so, our new bounds involve the "multi-letter" relative entropy between the distribution of the representations (or labels) of the training and test sets and a fixed prior. In particular, these new bounds reflect the structure of the encoder and are not vacuous for deterministic algorithms. Our compressibility approach, which is information-theoretic in nature, builds upon that of Blum-Langford for PAC-MDL bounds and introduces two essential ingredients: block-coding and lossy-compression. The latter allows our approach to subsume the so-called geometrical compressibility as a special case. To the best knowledge of the authors, the established generalization bounds are the first of their kind for Information Bottleneck (IB) type encoders and representation learning. Finally, we partly exploit the theoretical results by introducing a new data-dependent prior. Numerical simulations illustrate the advantages of well-chosen such priors over classical priors used in IB.


title: Security Advice for Parents and Children About Content Filtering and Circumvention as Found on YouTube and TikTok

abstract: In today's digital age, concerns about online security and privacy have become paramount. However, addressing these issues can be difficult, especially within the context of family relationships, wherein parents and children may have conflicting interests. In this environment, parents and children may turn to online security advice to determine how to proceed. In this paper, we examine the advice available to parents and children regarding content filtering and circumvention as found on YouTube and TikTok. In an analysis of 839 videos returned from queries on these topics, we found that half (n=399) provide relevant advice. Our results show that of these videos, roughly three-quarters are accurate, with the remaining one-fourth containing factually incorrect advice. We find that videos targeting children are both more likely to be incorrect and actionable than videos targeting parents, leaving children at increased risk of taking harmful action. Moreover, we find that while advice videos targeting parents will occasionally discuss the ethics of content filtering and device monitoring (including recommendations to respect children's autonomy) no such discussion of the ethics or risks of circumventing content filtering is given to children, leaving them unaware of any risks that may be involved with doing so. Ultimately, our research indicates that video-based social media sites are already effective sources of security advice propagation and that the public would benefit from security researchers and practitioners engaging more with these platforms, both for the creation of content and of tools designed to help with more effective filtering.


title: Learning Best-in-Class Policies for the Predict-then-Optimize Framework

abstract: We propose a novel family of decision-aware surrogate losses, called Perturbation Gradient (PG) losses, for the predict-then-optimize framework. These losses directly approximate the downstream decision loss and can be optimized using off-the-shelf gradient-based methods. Importantly, unlike existing surrogate losses, the approximation error of our PG losses vanishes as the number of samples grows. This implies that optimizing our surrogate loss yields a best-in-class policy asymptotically, even in misspecified settings. This is the first such result in misspecified settings and we provide numerical evidence confirming our PG losses substantively outperform existing proposals when the underlying model is misspecified and the noise is not centrally symmetric. Insofar as misspecification is commonplace in practice -- especially when we might prefer a simpler, more interpretable model -- PG losses offer a novel, theoretically justified, method for computationally tractable decision-aware learning.


title: Synthetic spectra are (usually) cellular

abstract: If $E$ is a connective ring spectrum, then Pstragowski's category $Syn_E$ of $E$-synthetic spectra is generated by the bigraded spheres $S^{i,j}$. In particular, it is equivalent to the category of modules over a filtered ring spectrum.


title: Freeze-Tag in $L_1$ has Wake-up Time Five

abstract: The Freeze-Tag Problem, introduced in Arkin et al. (SODA'02) consists of waking up a swarm of $n$ robots, starting from a single active robot. In the basic geometric version, every robot is given coordinates in the plane. As soon as a robot is awakened, it can move towards inactive robots to wake them up. The goal is to minimize the wake-up time of the last robot, the makespan. Despite significant progress on the computational complexity of this problem and on approximation algorithms, the characterization of exact bounds on the makespan remains one of the main open questions. In this paper, we settle this question for the $\ell_1$-norm, showing that a makespan of at most $5r$ can always be achieved, where $r$ is the maximum distance between the initial active robot and any sleeping robot. Moreover, a schedule achieving a makespan of at most $5r$ can be computed in optimal time $O(n)$. Both bounds, the time and the makespan are optimal. This implies a new upper bound of $5\sqrt{2}r \approx 7.07r$ on the makespan in the $\ell_2$-norm, improving the best known bound so far $(5+2\sqrt{2}+\sqrt{5})r \approx 10.06r$.


title: Meeting Bridges: Designing Information Artifacts that Bridge from Synchronous Meetings to Asynchronous Collaboration

abstract: A recent surge in remote meetings has led to complaints of ``Zoom fatigue'' and ``collaboration overload,'' negatively impacting worker productivity and well-being. One way to alleviate the burden of meetings is to de-emphasize their synchronous participation by shifting work to and enabling sensemaking during post-meeting asynchronous activities. Towards this goal, we propose the design concept of meeting bridges, or information artifacts that can encapsulate meeting information towards bridging to and facilitating post-meeting activities. Through 13 interviews and a survey of 198 information workers, we learn how people use online meeting information after meetings are over, finding five main uses: as an archive, as task reminders, to onboard or support inclusion, for group sensemaking, and as a launching point for follow-on collaboration. However, we also find that current common meeting artifacts, such as notes and recordings, present challenges in serving as meeting bridges. After conducting co-design sessions with 16 participants, we distill key principles for the design of meeting bridges to optimally support asynchronous collaboration goals. Overall, our findings point to the opportunity of designing information artifacts that not only support users to access but also continue to transform and engage in meeting information post-meeting.


title: Production of charged kaons in $Ar Sc$ collisions

abstract: Inclusive spectra of the kaons produced in $Ar Sc$ collisions as functions of their transverse momentum $p_T$ at mid-rapidity have been calculated within the approach based on the assumption of the similarity of inclusive spectra of the hadrons produced in nucleus-nucleus collisions at their small transverse momenta in the mid-rapidity region taking into account the quark-gluon dynamics in nucleon-nucleon interactions. This article gives a satisfactory description of NA61/SHINE data on $p_T$-spectra of the $K^\pm$ mesons produced in $ArSc$ collisions at the mid-rapdity ($y\simeq$ 0).


title: Characteristics and development of the main phase disturbance in geomagnetic storms (Dst $\le$ -50 nT)

abstract: We present geomagnetic storms (GSs) selected from three solar cycles, spanning the years 1995 to 2022. We studied the development of the main phase of storms within disturbance storm time (Dst) amplitudes ranging from Dst =-64 nT to Dst=- 422 nT. In order to determine the solar wind (SW) parameters that mainly influence the main phase development of a GS, which can best describe the SW-magnetosphere coupling, we divided our selected GSs into four groups based on main phase duration. Superposed epoch analysis was performed on the selected geomagnetic indices, SW plasma and field parameters, and their derivatives separately for each group. To that end, the dynamics of GS main phase development is mainly guided by interplanetary driver magnetic field southward component, (-Bz). It has been determined that there is a temporal difference between the peak values of Bz and Dst. As a result, Dst is delayed from Bz by 1-4 hours, which is crucial for space weather forecasting. The peak of Dst has a direct relationship with the amplitude of storm sudden commencement (SSC) and an inverse relationship with the duration of SSC. The inter-relationship between the peaks of the three indices (Dst, AE, and ap) during GS, is also obtained. Dst is found to be more closely related to ap than AE. To determine the best fit SW parameter to the geomagnetic activity indices, we used a linear correlation between the peak values of individual geomagnetic indices and SW plasma and field parameters and their derivatives. An electric field related function involving speed and IMF (v$^{4/3}$Bz) when coupled with a viscous term ($\rho^{1/2}$) correlates very well with the intensity of the GS (Dst$ _{min} $ or $ \Delta$Dst) and the magnitude of (ap$_{max}$) and (AE$_{max}$) during storms. However, a related function (v$^{4/3}$B$\rho^{1/2}$) represents slightly better the peak of AE$_{max}$ during the storms.


title: The $B_{s}\to \mu^{+}\mu^{-}\gamma$ decay rate at large $q^{2}$ from lattice QCD

abstract: We determine, by means of lattice QCD calculations, the local form factors describing the $B_{s}\to \mu^{+}\mu^{-}\gamma$ decay. For this analysis we make use of the gauge configurations produced by the ETM Collaboration with $N_{f}=2+1+1$ flavour of Wilson-Clover twisted-mass fermions at maximal twist. To obtain the $B_{s}$ meson form-factors, we perform simulations for several heavy-strange meson masses $m_{H_{s}}$ in the range $m_{H_{s}} \in [ m_{D_{s}}, 2 m_{D_{s}} ]$, and extrapolate to the physical $B_{s}$ meson point $m_{B_{s}}\simeq 5.367~{\rm GeV}$ making use of the HQET scaling laws. We cover the region of large di-muon invariant masses $\sqrt{q^{2}} > 4.16\,{\rm GeV}$, and use our results to determine the branching fraction for $B_{s}\to \mu^{+}\mu^{-}\gamma$, which has been recently measured by LHCb in the region $\sqrt{q^{2}} > 4.9\,{\rm GeV}$. The largest contribution to the uncertainty in the partial branching fractions at values of $\sqrt{q^{2}} < 4.8\,{\rm GeV}$ is now due to resonance and other long-distance effects, including those from "charming penguins", which we estimate by summing over the contributions from the $J_P=1^-$ charmonium resonances.


title: Small area estimation of forest biomass via a two-stage model for continuous zero-inflated data

abstract: The United States (US) Forest Inventory & Analysis Program (FIA) collects data on and monitors the trends of forests in the US. FIA is increasingly interested in monitoring forest attributes such as biomass at fine geographic and temporal scales, resulting in a need for assessment and development of small area estimation techniques in forest inventory. We implement a small area estimator and parametric bootstrap estimator that account for zero-inflation in biomass data via a two-stage model-based approach and compare its performance to a post-stratified estimator and to the unit- and area-level empirical best linear unbiased prediction (EBLUP) estimators. For estimator comparison, we conduct a simulation study with counties in the US state Nevada as domains based on sampled plot data and remote sensing data products. Results show the zero-inflated estimator has the lowest relative bias and the smallest empirical root mean square error. Moreover, the 95% confidence interval coverages of the zero-inflated estimator and the unit-level EBLUP are more accurate than the other two estimators. To further illustrate the practical utility, we employ a data application across the 2019 measurement year in Nevada. We introduce the R package, saeczi, which efficiently implements the zero-inflated estimator and its mean squared error estimator.


title: MobilityGPT: Enhanced Human Mobility Modeling with a GPT model

abstract: Generative models have shown promising results in capturing human mobility characteristics and generating synthetic trajectories. However, it remains challenging to ensure that the generated geospatial mobility data is semantically realistic, including consistent location sequences, and reflects real-world characteristics, such as constraining on geospatial limits. We reformat human mobility modeling as an autoregressive generation task to address these issues, leveraging the Generative Pre-trained Transformer (GPT) architecture. To ensure its controllable generation to alleviate the above challenges, we propose a geospatially-aware generative model, MobilityGPT. We propose a gravity-based sampling method to train a transformer for semantic sequence similarity. Then, we constrained the training process via a road connectivity matrix that provides the connectivity of sequences in trajectory generation, thereby keeping generated trajectories in geospatial limits. Lastly, we proposed to construct a preference dataset for fine-tuning MobilityGPT via Reinforcement Learning from Trajectory Feedback (RLTF) mechanism, which minimizes the travel distance between training and the synthetically generated trajectories. Experiments on real-world datasets demonstrate MobilityGPT's superior performance over state-of-the-art methods in generating high-quality mobility trajectories that are closest to real data in terms of origin-destination similarity, trip length, travel radius, link, and gravity distributions.


title: Symmetries and conservation laws of a fifth-order KdV equation with time-dependent coefficients and linear damping

abstract: A fifth-order KdV equation with time dependent coefficients and linear damping has been studied. Symmetry groups have several different applications in the context of nonlinear differential equations. For instance, they can be used to determine conservation laws. We obtain the symmetries of the model applying Lie's classical method. The choice of some arbitrary functions of the equation by the equivalence transformation enhances the study of Lie symmetries of the equation. We have determined the subclasses of the equation which are nonlinearly self-adjoint. This allow us to obtain conservation laws by using a theorem proved by Ibragimov which is based on the concept of adjoint equation for nonlinear differential equations.


title: Constructing massive particles surfaces in static spacetimes

abstract: The procedure for constructing the massive particle surfaces in static space-times is described in detail and the equivalence of the main results with the results of the geodesic approach is demonstrated.


title: Sojourns of locally self-similar Gaussian processes

abstract: Given a Gaussian risk process $R(t)=u+c(t)-X(t),t\ge 0$, the cumulative Parisian ruin probability on a finite time interval $[0,T]$ with respect to $L \geq 0$ is defined as the probability that the sojourn time that the risk process $R$ spends under the level 0 on this time interval $[0,T]$ exceeds $L$. In this contribution we derive exact asymptotic approximations of the cumulative Parisian ruin probability for a general class of Gaussian processes introduced in [9] assuming that $X$ is locally self-similar. We illustrate our findings with several examples. As a byproduct we show that Berman's constants can be defined alternatively by a self-similar Gaussian process which could be quite different to the fractional Brownian motion.


title: Understanding Reasoning Ability of Language Models From the Perspective of Reasoning Paths Aggregation

abstract: Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning capability, we propose that we can view an LM as deriving new conclusions by aggregating indirect reasoning paths seen at pre-training time. We found this perspective effective in two important cases of reasoning: logic reasoning with knowledge graphs (KGs) and chain-of-thought (CoT) reasoning. More specifically, we formalize the reasoning paths as random walk paths on the knowledge/reasoning graphs. Analyses of learned LM distributions suggest that a weighted sum of relevant random walk path probabilities is a reasonable way to explain how LMs reason. Experiments and analysis on multiple KG and CoT datasets reveal the effect of training on random walk paths and suggest that augmenting unlabeled random walk reasoning paths can improve real-world multi-step reasoning performance. code: https://github.com/WANGXinyiLinda/LM_random_walk


title: ISPA: Inter-Species Phonetic Alphabet for Transcribing Animal Sounds

abstract: Traditionally, bioacoustics has relied on spectrograms and continuous, per-frame audio representations for the analysis of animal sounds, also serving as input to machine learning models. Meanwhile, the International Phonetic Alphabet (IPA) system has provided an interpretable, language-independent method for transcribing human speech sounds. In this paper, we introduce ISPA (Inter-Species Phonetic Alphabet), a precise, concise, and interpretable system designed for transcribing animal sounds into text. We compare acoustics-based and feature-based methods for transcribing and classifying animal sounds, demonstrating their comparable performance with baseline methods utilizing continuous, dense audio representations. By representing animal sounds with text, we effectively treat them as a "foreign language," and we show that established human language ML paradigms and models, such as language models, can be successfully applied to improve performance.


title: Multiclass Classification Procedure for Detecting Attacks on MQTT-IoT Protocol

abstract: The large number of sensors and actuators that make up the Internet of Things obliges these systems to use diverse technologies and protocols. This means that IoT networks are more heterogeneous than traditional networks. This gives rise to new challenges in cybersecurity to protect these systems and devices which are characterized by being connected continuously to the Internet. Intrusion detection systems (IDS) are used to protect IoT systems from the various anomalies and attacks at the network level. Intrusion Detection Systems (IDS) can be improved through machine learning techniques. Our work focuses on creating classification models that can feed an IDS using a dataset containing frames under attacks of an IoT system that uses the MQTT protocol. We have addressed two types of method for classifying the attacks, ensemble methods and deep learning models, more specifically recurrent networks with very satisfactory results.


title: Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models

abstract: In the face of uncertainty, the ability to *seek information* is of fundamental importance. In many practical applications, such as medical diagnosis and troubleshooting, the information needed to solve the task is not initially given and has to be actively sought by asking follow-up questions (for example, a doctor asking a patient for more details about their symptoms). In this work, we introduce Uncertainty of Thoughts (UoT), an algorithm to augment large language models with the ability to actively seek information by asking effective questions. UoT combines 1) an *uncertainty-aware simulation approach* which enables the model to simulate possible future scenarios and how likely they are to occur, 2) *uncertainty-based rewards* motivated by information gain which incentivizes the model to seek information, and 3) a *reward propagation scheme* to select the optimal question to ask in a way that maximizes the expected reward. In experiments on medical diagnosis, troubleshooting, and the `20 Questions` game, UoT achieves an average performance improvement of 38.1% in the rate of successful task completion across multiple LLMs compared with direct prompting and also improves efficiency (i.e., the number of questions needed to complete the task). Our code has been released [here](https://github.com/zhiyuanhubj/UoT)


title: Phonon and exciton temperature-dependent properties of twisted MoS$_2$

abstract: In the present work, Raman and photoluminescence spectroscopies were used to study the dynamics of phonons and different excitons of MoS$_2$ bilayer under a rotation of 29$^{\circ}$ dependent of the temperature. The twisted bilayer (T-2L) of MoS$_2$ was obtained through mechanical exfoliation, and subsequently rotated using a dimethyl polysiloxane (PDMS) substrate and deterministic transferred to a SiO$_2$ substrate. The Raman spectrum of the twisted bilayer presents three peaks E$'$ (386 cm$^{-1}$), A$'_{1}$ (405 cm$^{-1}$) and an FA$'$ peak at approximately 409 cm$^{-1}$ linked to the A$'_{1}$ mode, which is attributed to a Moir\'e pattern phonon. Both modes (A$'_{1}$ and FA$'$) are dependent of light polarization in a way that demonstrates an effective coupling between the layers. It was also verified through the Gr\"uneisen parameter, an increase in the anharmonicity of the mode in the E$'$ plane and a decrease the same for A$'_{1}$. In the PL measurements, the appearance of an exciton in T-2L was verified, which generated a second shoulder measured at $\approx$1.58 eV attributed to an indirect transition of an I trion. The interaction between the rotated monolayers of MoS$_{2}$ proved to be an important parameter for possible fine-tuning of the properties of bilayer samples.


title: Algorithms and Complexity of Difference Logic

abstract: Difference Logic (DL) is a fragment of linear arithmetics where atoms are constraints x+k <= y for variables x,y (ranging over Q or Z) and integer k. We study the complexity of deciding the truth of existential DL sentences. This problem appears in many contexts: examples include verification, bioinformatics, telecommunications, and spatio-temporal reasoning in AI. We begin by considering sentences in CNF with rational-valued variables. We restrict the allowed clauses via two natural parameters: arity and coefficient bounds. The problem is NP-hard for most choices of these parameters. As a response to this, we refine our understanding by analyzing the time complexity and the parameterized complexity (with respect to well-studied parameters such as primal and incidence treewidth). We obtain a comprehensive picture of the complexity landscape in both cases. Finally, we generalize our results to integer domains and sentences that are not in CNF.


title: Bounding the Weisfeiler-Leman Dimension via a Depth Analysis of I/R-Trees

abstract: The Weisfeiler-Leman (WL) dimension is an established measure for the inherent descriptive complexity of graphs and relational structures. It corresponds to the number of variables that are needed and sufficient to define the object of interest in a counting version of first-order logic (FO). These bounded-variable counting logics were even candidates to capture graph isomorphism, until a celebrated construction due to Cai, F\"urer, and Immerman [Combinatorica 1992] showed that $\Omega(n)$ variables are required to distinguish all non-isomorphic $n$-vertex graphs. Still, very little is known about the precise number of variables required and sufficient to define every $n$-vertex graph. For the bounded-variable (non-counting) FO fragments, Pikhurko, Veith, and Verbitsky [Discret. Appl. Math. 2006] provided an upper bound of $\frac{n+3}{2}$ and showed that it is essentially tight. Our main result yields that, in the presence of counting quantifiers, $\frac{n}{4} + o(n)$ variables suffice. This shows that counting does allow us to save variables when defining graphs. As an application of our techniques, we also show new bounds in terms of the vertex cover number of the graph. To obtain the results, we introduce a new concept called the WL depth of a graph. We use it to analyze branching trees within the Individualization/Refinement (I/R) paradigm from the domain of isomorphism algorithms. We extend the recursive procedure from the I/R paradigm by the possibility of splitting the graphs into independent parts. Then we bound the depth of the obtained branching trees, which translates into bounds on the WL dimension and thereby on the number of variables that suffice to define the graphs.


title: Simulation thinning algorithm for a CARMA(p,q)-Hawkes model

abstract: This paper presents an algorithm for the simulation of Hawkes-type processes where the intensity is expressed in terms of a continuous-time autoregressive moving average model. We identify upper bounds for both the univariate and the multivariate intensity functions that are used to develop simulation algorithms based on the thinning technique.


title: An approximation of the Collatz map and a lower bound for the average total stopping time

abstract: Define the (accelerated) Collatz map on the positive integers by $\mathsf{Col}_2(n)=\frac{n}{2}$ if $n$ is even and $\mathsf{Col}_2(n)=\frac{3n+1}{2}$ if $n$ is odd. We show that $\mathsf{Col}_2$ can be approximated by multiplication with $\frac{3^{\frac{1}{2}}}{2}$ in the sense that the set of $n$ for which $(\frac{3^{\frac{1}{2}}}{2})^kn^{1-\epsilon}\leq \mathsf{Col}_2^k(n)\leq (\frac{3^{\frac{1}{2}}}{2})^kn^{1+\epsilon}$ for all $0\leq k\leq 2(\log\frac{4}{3})^{-1}\log n\approx 6.952\log n$ has natural density $1$ for every $\epsilon>0$. Let $\tau(n)$ be the minimal $k\in\mathbb{N}$ for which $\mathsf{Col}_2^k(n)=1$ if there exist such a $k$ and set $\tau(n)=\infty$ otherwise. As an application of the above we show that $\liminf_{x\rightarrow\infty}\frac{1}{x\log x}\sum_{m=1}^{\lfloor x\rfloor}\tau(m)\geq 2(\log\frac{4}{3})^{-1}$, partially answering a question of Crandall and Shanks. We show also that assuming the Collatz Conjecture is true in the strong sense that $\tau(n)\in O(\log n)$, then $\lim_{x\rightarrow\infty}\frac{1}{x\log x}\sum_{m=1}^{\lfloor x\rfloor}\tau(m)= 2(\log\frac{4}{3})^{-1}$.


title: Event-based Product Carousel Recommendation with Query-Click Graph

abstract: Many current recommender systems mainly focus on the product-to-product recommendations and user-to-product recommendations even during the time of events rather than modeling the typical recommendations for the target event (e.g., festivals, seasonal activities, or social activities) without addressing the multiple aspects of the shopping demands for the target event. Product recommendations for the multiple aspects of the target event are usually generated by human curators who manually identify the aspects and select a list of aspect-related products (i.e., product carousel) for each aspect as recommendations. However, building a recommender system with machine learning is non-trivial due to the lack of both the ground truth of event-related aspects and the aspect-related products. To fill this gap, we define the novel problem as the event-based product carousel recommendations in e-commerce and propose an effective recommender system based on the query-click bipartite graph. We apply the iterative clustering algorithm over the query-click bipartite graph and infer the event-related aspects by the clusters of queries. The aspect-related recommendations are powered by the click-through rate of products regarding each aspect. We show through experiments that this approach effectively mines product carousels for the target event.


title: Wild orbits and generalised singularity modules: stratifications and quantisation

abstract: We study isomorphism classes of untwisted irregular singular meromorphic connections on principal bundles over (wild) Riemann surfaces, for any complex reductive structure group $G$ and polar divisor. In particular we compute the stabilisers of suitable marked points on their principal part orbits, showing the stabilisers are connected and controlled by the corresponding filtration of (Levi factors of) nested parabolic subgroups of $G$; this uniquely determines the orbits as complex homogeneous manifolds for groups of jets of principal $G$-bundle automorphisms. Moreover, when the residue is semisimple we stratify the space of orbits by the stabilisers, relating this to local wild mapping class groups and generalising the Levi stratification of a Cartan subalgebra $\mathfrak{t} \subseteq \mathfrak{g} = \operatorname{Lie}(G)$: the dense stratum corresponds to the generic setting of irregular isomonodromic deformations \`a la Jimbo-Miwa-Ueno. Then we adapt a result of Alekseev-Lachowska to deformation-quantise nongeneric orbits: the $\ast$-product involves affine-Lie-algebra modules, extending the generalised Verma modules (in the case of regular singularities) and the `singularity' modules of F.-R. (in the case of generic irregular singularities). As in the generic case, the modules contain Whittaker vectors for the Gaiotto-Teschner Virasoro pairs from irregular Liouville conformal field theory; but they now provide all the quotients which are obtained when the corresponding parameters leave the aforementioned dense strata. We also construct Shapovalov forms for the corresponding representations of truncated (holomorphic) current Lie algebras, leading to a conjectural irreducibility criterion. Finally, we use these representations to construct new flat vector bundles of vacua/covacua \`a la Wess--Zumino-Novikov-Witten, equipped with connections \`a la Knizhnik-Zamolodchikov.


title: Stepping into the Right Shoes: The Effects of User-Matched Avatar Ethnicity and Gender on Sense of Embodiment in Virtual Reality

abstract: In many consumer virtual reality (VR) applications, users embody predefined characters that offer minimal customization options, frequently emphasizing storytelling over user choice. We explore whether matching a user's physical characteristics, specifically ethnicity and gender, with their virtual self-avatar affects their sense of embodiment in VR. We conducted a 2 x 2 within-subjects experiment (n=32) with a diverse user population to explore the impact of matching or not matching a user's self-avatar to their ethnicity and gender on their sense of embodiment. Our results indicate that matching the ethnicity of the user and their self-avatar significantly enhances sense of embodiment regardless of gender, extending across various aspects, including appearance, response, and ownership. We also found that matching gender significantly enhanced ownership, suggesting that this aspect is influenced by matching both ethnicity and gender. Interestingly, we found that matching ethnicity specifically affects self-location while matching gender specifically affects one's body ownership.


title: On additive complement with special structures

abstract: Let $A$ be a set of natural numbers. A set $B$, a set of natural numbers, is said to be an additive complement of the set $A$ if all sufficiently large natural numbers can be represented in the form $x+y$, where $x\in A$ and $y\in B$. This article describes various types of additive complements of the set $A$ such as those additive complement of $A$ that does not intersects $A$, additive complements of the form of the union of disjoint infinite arithmetic progressions, additive complement having various density etc. As an application of this study, we also focus on the structure of sumset of arithmetic progression and geometric progression. Apart from this, for given positive real no. $\alpha \leq 1$ and finite set $A$, we investigate a set $B$ such that it can be written as union of disjoint infinite arithmetic progression and density of $A+B$ is $\alpha$.


title: A note on the Winterbottom shape

abstract: In this short note we review results on equilibrium shapes of minimizers to the sessile drop problem. More precisely, we study the Winterbottom problem and prove that the Winterbottom shape is indeed optimal. The arguments presented here are based on relaxation and the (anisotropic) isoperimetric inequality.


title: A Theoretical Framework for Partially Observed Reward-States in RLHF

abstract: The growing deployment of reinforcement learning from human feedback (RLHF) calls for a deeper theoretical investigation of its underlying models. The prevalent models of RLHF do not account for neuroscience-backed, partially-observed "internal states" that can affect human feedback, nor do they accommodate intermediate feedback during an interaction. Both of these can be instrumental in speeding up learning and improving alignment. To address these limitations, we model RLHF as reinforcement learning with partially observed reward-states (PORRL). We accommodate two kinds of feedback $-$ cardinal and dueling feedback. We first demonstrate that PORRL subsumes a wide class of RL problems, including traditional RL, RLHF, and reward machines. For cardinal feedback, we present two model-based methods (POR-UCRL, POR-UCBVI). We give both cardinal regret and sample complexity guarantees for the methods, showing that they improve over naive history-summarization. We then discuss the benefits of a model-free method like GOLF with naive history-summarization in settings with recursive internal states and dense intermediate feedback. For this purpose, we define a new history aware version of the Bellman-eluder dimension and give a new guarantee for GOLF in our setting, which can be exponentially sharper in illustrative examples. For dueling feedback, we show that a naive reduction to cardinal feedback fails to achieve sublinear dueling regret. We then present the first explicit reduction that converts guarantees for cardinal regret to dueling regret. In both feedback settings, we show that our models and guarantees generalize and extend existing ones.


title: Towards a Flexible Scale-out Framework for Efficient Visual Data Query Processing

abstract: There is growing interest in visual data management systems that support queries with specialized operations ranging from resizing an image to running complex machine learning models. With a plethora of such operations, the basic need to receive query responses in minimal time takes a hit, especially when the client desires to run multiple such operations in a single query. Existing systems provide an ad-hoc approach where different solutions are clubbed together to provide an end-to-end visual data management system. Unlike such solutions, the Visual Data Management System (VDMS) natively executes queries with multiple operations, thus providing an end-to-end solution. However, a fixed subset of native operations and a synchronous threading architecture limit its generality and scalability. In this paper, we develop VDMS-Async that adds the capability to run user-defined operations with VDMS and execute operations within a query on a remote server. VDMS-Async utilizes an event-driven architecture to create an efficient pipeline for executing operations within a query. Our experiments have shown that VDMS-Async reduces the query execution time by 2-3X compared to existing state-of-the-art systems. Further, remote operations coupled with an event-driven architecture enables VDMS-Async to scale query execution time linearly with the addition of every new remote server. We demonstrate a 64X reduction in query execution time when adding 64 remote servers.


title: Deal, or no deal (or who knows)? Forecasting Uncertainty in Conversations using Large Language Models

abstract: Effective interlocutors account for the uncertain goals, beliefs, and emotions of others. But even the best human conversationalist cannot perfectly anticipate the trajectory of a dialogue. How well can language models represent inherent uncertainty in conversations? We propose FortUne Dial, an expansion of the long-standing "conversation forecasting" task: instead of just accuracy, evaluation is conducted with uncertainty-aware metrics, effectively enabling abstention on individual instances. We study two ways in which language models potentially represent outcome uncertainty (internally, using scores and directly, using tokens) and propose fine-tuning strategies to improve calibration of both representations. Experiments on eight difficult negotiation corpora demonstrate that our proposed fine-tuning strategies (a traditional supervision strategy and an off-policy reinforcement learning strategy) can calibrate smaller open-source models to compete with pre-trained models 10x their size.


title: Estimating position-dependent and anisotropic diffusivity tensors from molecular dynamics trajectories: Existing methods and future outlook

abstract: Confinement can substantially alter the physicochemical properties of materials by breaking translational isotropy and rendering all physical properties position-dependent. Molecular dynamics (MD) simulations have proven instrumental in characterizing such spatial heterogeneities and probing the impact of confinement on materials' properties. For static properties, this is a straightforward task and can be achieved via simple spatial binning. Such an approach, however, cannot be readily applied to transport coefficients due to lack of natural extensions of autocorrelations used for their calculation in the bulk. The prime example of this challenge is diffusivity, which, in the bulk, can be readily estimated from the particles' mobility statistics, which satisfy the Fokker-Planck equation. Under confinement, however, such statistics will follow the Smoluchowski equation, which lacks a closed-form analytical solution. This brief review explores the rich history of estimating profiles of the diffusivity tensor from MD simulations and discusses various approximate methods and algorithms developed for this purpose. Beside discussing heuristic extensions of bulk methods, we overview more rigorous algorithms, including kernel-based methods, Bayesian approaches, and operator discretization techniques. Additionally, we outline methods based on applying biasing potentials or imposing constraints on tracer particles. Finally, we discuss approaches that estimate diffusivity from mean first passage time or committor probability profiles, a conceptual framework originally developed in the context of collective variable spaces describing rare events in computational chemistry and biology. In summary, this paper offers a concise survey of diverse approaches for estimating diffusivity from MD trajectories, highlighting challenges and opportunities in this area.


title: Training-Free Consistent Text-to-Image Generation

abstract: Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language. However, using these models to consistently portray the same subject across diverse prompts remains challenging. Existing approaches fine-tune the model to teach it new words that describe specific user-provided subjects or add image conditioning to the model. These methods require lengthy per-subject optimization or large-scale pre-training. Moreover, they struggle to align generated images with text prompts and face difficulties in portraying multiple subjects. Here, we present ConsiStory, a training-free approach that enables consistent subject generation by sharing the internal activations of the pretrained model. We introduce a subject-driven shared attention block and correspondence-based feature injection to promote subject consistency between images. Additionally, we develop strategies to encourage layout diversity while maintaining subject consistency. We compare ConsiStory to a range of baselines, and demonstrate state-of-the-art performance on subject consistency and text alignment, without requiring a single optimization step. Finally, ConsiStory can naturally extend to multi-subject scenarios, and even enable training-free personalization for common objects.


title: A Lennard-Jones Layer for Distribution Normalization

abstract: We introduce the Lennard-Jones layer (LJL) for the equalization of the density of 2D and 3D point clouds through systematically rearranging points without destroying their overall structure (distribution normalization). LJL simulates a dissipative process of repulsive and weakly attractive interactions between individual points by considering the nearest neighbor of each point at a given moment in time. This pushes the particles into a potential valley, reaching a well-defined stable configuration that approximates an equidistant sampling after the stabilization process. We apply LJLs to redistribute randomly generated point clouds into a randomized uniform distribution. Moreover, LJLs are embedded in the generation process of point cloud networks by adding them at later stages of the inference process. The improvements in 3D point cloud generation utilizing LJLs are evaluated qualitatively and quantitatively. Finally, we apply LJLs to improve the point distribution of a score-based 3D point cloud denoising network. In general, we demonstrate that LJLs are effective for distribution normalization which can be applied at negligible cost without retraining the given neural network.


title: The origin of kinematically-persistent planes of satellite galaxies as driven by the early evolution of the local Cosmic Web in $\Lambda$CDM

abstract: Kinematically-persistent planes of satellites (KPPs) are fixed sets of satellites co-orbiting around their host galaxy, whose orbital poles are conserved and clustered across long cosmic time intervals. They play the role of 'skeletons', ensuring the long-term durability of positional planes. We explore the physical processes behind their formation in terms of the dynamics of the local Cosmic Web (CW), characterized via the so-called Lagrangian Volumes (LVs) built up around two zoom-in, cosmological hydro-simulations of MW-mass disk galaxy + satellites systems, where three KPPs have been identified. By analyzing the LVs deformations in terms of the reduced Tensor of Inertia (TOI), we find an outstanding alignment between the LV principal directions and KPP satellites' orbital poles. The most compressive local mass flows (along the $\hat{e}_3$ eigenvector) are strong at early times, feeding the so-called $\hat{e}_3$-structure, while the smallest TOI axis rapidly decreases. The $\hat{e}_3$-structure collapse marks the end of this regime and is the timescale for the establishment of satellite orbital pole clustering when the Universe is $\lesssim$ 4 Gyr old. KPP proto-satellites aligned with $\hat{e}_3$ are those whose orbital poles are either aligned from early times, or have been successfully bent at $\hat{e}_3$-structure collapse. KPP satellites associated to $\hat{e}_1$ tend to have early trajectories already parallel to $\hat{e}_3$. We show that KPPs can arise as a result of the $\Lambda$CDM-predicted large-scale dynamics acting on particular sets of proto-satellites, the same dynamics that shape the local CW environment.


title: Make Every Move Count: LLM-based High-Quality RTL Code Generation Using MCTS

abstract: Existing large language models (LLMs) for register transfer level code generation face challenges like compilation failures and suboptimal power, performance, and area (PPA) efficiency. This is due to the lack of PPA awareness in conventional transformer decoding algorithms. In response, we present an automated transformer decoding algorithm that integrates Monte Carlo tree-search for lookahead, guiding the transformer to produce compilable, functionally correct, and PPA-optimized code. Empirical evaluation with a fine-tuned language model on RTL codesets shows that our proposed technique consistently generates functionally correct code compared to prompting-only methods and effectively addresses the PPA-unawareness drawback of naive large language models. For the largest design generated by the state-of-the-art LLM (16-bit adder), our technique can achieve a 31.8% improvement in the area-delay product.


title: InstanceDiffusion: Instance-level Control for Image Generation

abstract: Text-to-image diffusion models produce high quality images but do not offer control over individual instances in the image. We introduce InstanceDiffusion that adds precise instance-level control to text-to-image diffusion models. InstanceDiffusion supports free-form language conditions per instance and allows flexible ways to specify instance locations such as simple single points, scribbles, bounding boxes or intricate instance segmentation masks, and combinations thereof. We propose three major changes to text-to-image models that enable precise instance-level control. Our UniFusion block enables instance-level conditions for text-to-image models, the ScaleU block improves image fidelity, and our Multi-instance Sampler improves generations for multiple instances. InstanceDiffusion significantly surpasses specialized state-of-the-art models for each location condition. Notably, on the COCO dataset, we outperform previous state-of-the-art by 20.4% AP$_{50}^\text{box}$ for box inputs, and 25.4% IoU for mask inputs.


title: Knowledge Acquisition and Integration with Expert-in-the-loop

abstract: Constructing and serving knowledge graphs (KGs) is an iterative and human-centered process involving on-demand programming and analysis. In this paper, we present Kyurem, a programmable and interactive widget library that facilitates human-in-the-loop knowledge acquisition and integration to enable continuous curation a knowledge graph (KG). Kyurem provides a seamless environment within computational notebooks where data scientists explore a KG to identify opportunities for acquiring new knowledge and verify recommendations provided by AI agents for integrating the acquired knowledge in the KG. We refined Kyurem through participatory design and conducted case studies in a real-world setting for evaluation. The case-studies show that introduction of Kyurem within an existing HR knowledge graph construction and serving platform improved the user experience of the experts and helped eradicate inefficiencies related to knowledge acquisition and integration tasks


title: Zero-shot Object-Level OOD Detection with Context-Aware Inpainting

abstract: Machine learning algorithms are increasingly provided as black-box cloud services or pre-trained models, without access to their training data. This motivates the problem of zero-shot out-of-distribution (OOD) detection. Concretely, we aim to detect OOD objects that do not belong to the classifier's label set but are erroneously classified as in-distribution (ID) objects. Our approach, RONIN, uses an off-the-shelf diffusion model to replace detected objects with inpainting. RONIN conditions the inpainting process with the predicted ID label, drawing the input object closer to the in-distribution domain. As a result, the reconstructed object is very close to the original in the ID cases and far in the OOD cases, allowing RONIN to effectively distinguish ID and OOD samples. Throughout extensive experiments, we demonstrate that RONIN achieves competitive results compared to previous approaches across several datasets, both in zero-shot and non-zero-shot settings.


title: Flora: Low-Rank Adapters Are Secretly Gradient Compressors

abstract: Despite large neural networks demonstrating remarkable abilities to complete different tasks, they require excessive memory usage to store the optimization states for training. To alleviate this, the low-rank adaptation (LoRA) is proposed to reduce the optimization states by training fewer parameters. However, LoRA restricts overall weight update matrices to be low-rank, limiting the model performance. In this work, we investigate the dynamics of LoRA and identify that it can be approximated by a random projection. Based on this observation, we propose Flora, which is able to achieve high-rank updates by resampling the projection matrices while enjoying the sublinear space complexity of optimization states. We conduct experiments across different tasks and model architectures to verify the effectiveness of our approach.


title: Observation of the fractional quantum spin Hall effect in moir\'e MoTe2

abstract: Quantum spin Hall (QSH) insulators are two-dimensional electronic materials that have a bulk band gap like an ordinary insulator but have topologically protected pairs of edge modes of opposite chiralities. To date, experimental studies have found only integer QSH insulators with counter-propagating up-spins and down-spins at each edge leading to a quantized conductance G0=e^2/h. Here we report transport evidence of a fractional QSH insulator in 2.1-degree-twisted bilayer MoTe2, which supports spin-Sz conservation and flat spin-contrasting Chern bands. At filling factor v = 3 of the moir\'e valence bands, each edge contributes a conductance 3/2 G0 with zero anomalous Hall conductivity. The state is likely a time-reversal pair of the even-denominator 3/2-fractional Chern insulators. Further, at v = 2, 4 and 6, we observe a single, double and triple QSH insulator with each edge contributing a conductance G0, 2G0 and 3G0, respectively. Our results open up the possibility of realizing time reversal symmetric non-abelian anyons and other unexpected topological phases in highly tunable moir\'e materials.


title: Ginger: An Efficient Curvature Approximation with Linear Complexity for General Neural Networks

abstract: Second-order optimization approaches like the generalized Gauss-Newton method are considered more powerful as they utilize the curvature information of the objective function with preconditioning matrices. Albeit offering tempting theoretical benefits, they are not easily applicable to modern deep learning. The major reason is due to the quadratic memory and cubic time complexity to compute the inverse of the matrix. These requirements are infeasible even with state-of-the-art hardware. In this work, we propose Ginger, an eigendecomposition for the inverse of the generalized Gauss-Newton matrix. Our method enjoys efficient linear memory and time complexity for each iteration. Instead of approximating the conditioning matrix, we directly maintain its inverse to make the approximation more accurate. We provide the convergence result of Ginger for non-convex objectives. Our experiments on different tasks with different model architectures verify the effectiveness of our method. Our code is publicly available.


title: Cusped hyperbolic Lagrangians as mirrors to lines in three-space

abstract: We construct a Lagrangian in the cotangent bundle of a 3-torus whose projection to the fiber is a neighborhood of a tropical curve with a single 4-valent vertex. This Lagrangian has an isolated conical singular point, and its smooth locus is diffeomorphic to the minimally-twisted five component chain link complement, a cusped hyperbolic 3-manifold. From this singular Lagrangian, we construct an immersed Lagrangian, and determine when it is unobstructed in the wrapped Fukaya category. We show, using quilted Floer theory, that for a generic line in projective 3-space, there is a local system on this immersed Lagrangian such that the resulting object of the wrapped Fukaya category is homologically mirror to an object of the derived category supported on the line.


title: Gravitational index of the heterotic string

abstract: The fundamental heterotic string has a tower of BPS states whose supersymmetric index has an exponential growth in the charges. We construct the saddle-point of the gravitational path integral corresponding to this index. The saddle-point configuration is a supersymmetric rotating non-extremal Euclidean black hole. This configuration is singular in the two-derivative theory. We show that the addition of higher-derivative terms in four-dimensional $N=2$ supergravity resolves the singularity. In doing so, we extend the recently-developed "new attractor mechanism" to include the effect of higher-derivative terms. Remarkably, the one-loop, four-derivative F-term contribution to the prepotential leads to a precise match of the gravitational and microscopic index. We also comment, using the effective theory near the horizon, on the possibility of a string-size near-extremal black hole. Our results clarify the meaning of different descriptions of this system in the literature. The thermal state transitions to a winding condensate and a gas of strings without ever reaching a small black hole, while the index is captured by the rotating Euclidean black hole solution and is constant and thus smoothly connected to the microscopic ensemble.


title: Mg nanostructures with controlled dominant c-plane or m-plane facets by DC magnetron sputter deposition

abstract: Magnesium nanostructures find increased use in applications for hydrogen storage, catalysis, waste treatment, and heat storage to name a few. Currently, most nanoparticles are made using a chemical synthesis approach, necessitating the use of organic solvents and yielding material covered in ligands. To apply these nanoparticles, one has to use them in paints or slurries for coating of surfaces, which again produces waste. In this communication we explore the possibilities of making magnesium nanostructures by a physical technique of magnetron sputtering and to control their crystallographic properties, i.e. the type of the dominating crystalline faces building up the external surface of the particle. We show that by applying different process parameters, it is possible to obtain dominating c-plane, mixed or dominating m-plane nanostructures. Since the surface-related adsorption processes are strongly related to the type of the crystalline plane, this report presents a clean, waste-free and large-scale approach to develop tailored nanostructured Mg coatings.


title: GUARD: Role-playing to Generate Natural-language Jailbreakings to Test Guideline Adherence of Large Language Models

abstract: The discovery of "jailbreaks" to bypass safety filters of Large Language Models (LLMs) and harmful responses have encouraged the community to implement safety measures. One major safety measure is to proactively test the LLMs with jailbreaks prior to the release. Therefore, such testing will require a method that can generate jailbreaks massively and efficiently. In this paper, we follow a novel yet intuitive strategy to generate jailbreaks in the style of the human generation. We propose a role-playing system that assigns four different roles to the user LLMs to collaborate on new jailbreaks. Furthermore, we collect existing jailbreaks and split them into different independent characteristics using clustering frequency and semantic patterns sentence by sentence. We organize these characteristics into a knowledge graph, making them more accessible and easier to retrieve. Our system of different roles will leverage this knowledge graph to generate new jailbreaks, which have proved effective in inducing LLMs to generate unethical or guideline-violating responses. In addition, we also pioneer a setting in our system that will automatically follow the government-issued guidelines to generate jailbreaks to test whether LLMs follow the guidelines accordingly. We refer to our system as GUARD (Guideline Upholding through Adaptive Role-play Diagnostics). We have empirically validated the effectiveness of GUARD on three cutting-edge open-sourced LLMs (Vicuna-13B, LongChat-7B, and Llama-2-7B), as well as a widely-utilized commercial LLM (ChatGPT). Moreover, our work extends to the realm of vision language models (MiniGPT-v2 and Gemini Vision Pro), showcasing GUARD's versatility and contributing valuable insights for the development of safer, more reliable LLM-based applications across diverse modalities.


title: DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

abstract: Mathematical reasoning poses a significant challenge for language models due to its complex and structured nature. In this paper, we introduce DeepSeekMath 7B, which continues pre-training DeepSeek-Coder-Base-v1.5 7B with 120B math-related tokens sourced from Common Crawl, together with natural language and code data. DeepSeekMath 7B has achieved an impressive score of 51.7% on the competition-level MATH benchmark without relying on external toolkits and voting techniques, approaching the performance level of Gemini-Ultra and GPT-4. Self-consistency over 64 samples from DeepSeekMath 7B achieves 60.9% on MATH. The mathematical reasoning capability of DeepSeekMath is attributed to two key factors: First, we harness the significant potential of publicly available web data through a meticulously engineered data selection pipeline. Second, we introduce Group Relative Policy Optimization (GRPO), a variant of Proximal Policy Optimization (PPO), that enhances mathematical reasoning abilities while concurrently optimizing the memory usage of PPO.


title: Two-loop amplitudes for ttH production: the quark-initiated Nf-part

abstract: We present numerical results for the two-loop virtual amplitude entering the NNLO corrections to Higgs boson production in association with a top quark pair at the LHC, focusing, as a proof of concept of our method, on the part of the quark-initiated channel containing loops of massless or massive quarks. Results for the UV renormalised and IR subtracted two-loop amplitude for each colour structure are given at selected phase-space points and visualised in terms of surfaces as a function of two-dimensional slices of the full phase space.


title: Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining

abstract: Accurate medical image segmentation demands the integration of multi-scale information, spanning from local features to global dependencies. However, it is challenging for existing methods to model long-range global information, where convolutional neural networks (CNNs) are constrained by their local receptive fields, and vision transformers (ViTs) suffer from high quadratic complexity of their attention mechanism. Recently, Mamba-based models have gained great attention for their impressive ability in long sequence modeling. Several studies have demonstrated that these models can outperform popular vision models in various tasks, offering higher accuracy, lower memory consumption, and less computational burden. However, existing Mamba-based models are mostly trained from scratch and do not explore the power of pretraining, which has been proven to be quite effective for data-efficient medical image analysis. This paper introduces a novel Mamba-based model, Swin-UMamba, designed specifically for medical image segmentation tasks, leveraging the advantages of ImageNet-based pretraining. Our experimental results reveal the vital role of ImageNet-based training in enhancing the performance of Mamba-based models. Swin-UMamba demonstrates superior performance with a large margin compared to CNNs, ViTs, and latest Mamba-based models. Notably, on AbdomenMRI, Encoscopy, and Microscopy datasets, Swin-UMamba outperforms its closest counterpart U-Mamba_Enc by an average score of 2.72%.


title: Nevermind: Instruction Override and Moderation in Large Language Models

abstract: Given the impressive capabilities of recent Large Language Models (LLMs), we investigate and benchmark the most popular proprietary and different sized open source models on the task of explicit instruction following in conflicting situations, e.g. overrides. These include the ability of the model to override the knowledge within the weights of the model, the ability to override (or moderate) extracted knowledge in the prompt, and lastly the ability to perform a full jailbreak. Experimentation performed suggest several key findings to improve instruction following - larger models perform the best in following instructions that override internal and contextual instructions, and are obedient, even to a fault. When scaling to longer contexts via rope scaling, a significant buffer needs to be maintained from the edge of the perplexity cliff in order to maintain instruction following capabilities. Finally, we observe improving instruction following, and subsequently instruction overrides/jailbreaks, is fundamentally at odds with the ability of a language model to follow given safety filters or guidelines. Thus, we postulate the most effective approach for safe, trustworthy AI should be dealt external to the LLM itself.


title: Sharp $L^2$ estimates for the drift heat equation on shrinking Ricci solitons

abstract: We prove an $L^2$ estimate for the drift heat equation on a complete gradient shrinking Ricci soliton. This estimate has a time-dependent weight which is Gaussian in its spatial asymptotics. When transferred and scaled to an estimate for the heat equation along the Ricci flow of the soliton, this estimate is uniform up to the singular time.


title: Do Diffusion Models Learn Semantically Meaningful and Efficient Representations?

abstract: Diffusion models are capable of impressive feats of image generation with uncommon juxtapositions such as astronauts riding horses on the moon with properly placed shadows. These outputs indicate the ability to perform compositional generalization, but how do the models do so? We perform controlled experiments on conditional DDPMs learning to generate 2D spherical Gaussian bumps centered at specified $x$- and $y$-positions. Our results show that the emergence of semantically meaningful latent representations is key to achieving high performance. En route to successful performance over learning, the model traverses three distinct phases of latent representations: (phase A) no latent structure, (phase B) a 2D manifold of disordered states, and (phase C) a 2D ordered manifold. Corresponding to each of these phases, we identify qualitatively different generation behaviors: 1) multiple bumps are generated, 2) one bump is generated but at inaccurate $x$ and $y$ locations, 3) a bump is generated at the correct $x$ and y location. Furthermore, we show that even under imbalanced datasets where features ($x$- versus $y$-positions) are represented with skewed frequencies, the learning process for $x$ and $y$ is coupled rather than factorized, demonstrating that simple vanilla-flavored diffusion models cannot learn efficient representations in which localization in $x$ and $y$ are factorized into separate 1D tasks. These findings suggest the need for future work to find inductive biases that will push generative models to discover and exploit factorizable independent structures in their inputs, which will be required to vault these models into more data-efficient regimes.


title: Fast solutions to k-parity and k-synchronisation using parallel automata networks

abstract: We present a family of automata networks that solve the k-parity problem when run in parallel. These solutions are constructed by connecting cliques in a non-cyclical fashion. The size of the local neighbourhood is linear in the size of the alphabet, and the convergence time is proven to always be the diameter of the interaction graph. We show that this family of solutions can be slightly altered to obtain an equivalent family of solutions to the k-synchronisation problem, which means that these solutions converge from any initial configuration to the cycle which contains all the uniform configurations over the alphabet, in order.


title: 4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes

abstract: We consider the problem of novel view synthesis (NVS) for dynamic scenes. Recent neural approaches have accomplished exceptional NVS results for static 3D scenes, but extensions to 4D time-varying scenes remain non-trivial. Prior efforts often encode dynamics by learning a canonical space plus implicit or explicit deformation fields, which struggle in challenging scenarios like sudden movements or capturing high-fidelity renderings. In this paper, we introduce 4D Gaussian Splatting (4DGS), a novel method that represents dynamic scenes with anisotropic 4D XYZT Gaussians, inspired by the success of 3D Gaussian Splatting in static scenes. We model dynamics at each timestamp by temporally slicing the 4D Gaussians, which naturally compose dynamic 3D Gaussians and can be seamlessly projected into images. As an explicit spatial-temporal representation, 4DGS demonstrates powerful capabilities for modeling complicated dynamics and fine details, especially for scenes with abrupt motions. We further implement our temporal slicing and splatting techniques in a highly optimized CUDA acceleration framework, achieving real-time inference rendering speeds of up to 277 FPS on an RTX 3090 GPU and 583 FPS on an RTX 4090 GPU. Rigorous evaluations on scenes with diverse motions showcase the superior efficiency and effectiveness of 4DGS, which consistently outperforms existing methods both quantitatively and qualitatively.


title: SIMUnet: an open-source tool for simultaneous global fits of EFT Wilson coefficients and PDFs

abstract: We present the open-source SIMUnet code, designed to fit Standard Model Effective Field Theory (SMEFT) Wilson coefficient alongside Parton Distribution Functions (PDFs) of the proton. SIMUnet can perform SMEFT global fits, as well as simultaneous fits of the PDFs and of an arbitrarily large number of SMEFT degrees of freedom, by including both PDF-dependent and PDF-independent observables. SIMUnet can also be used to determine whether the effects of any New Physics models can be fitted away in a global fit of PDFs. SIMUnet is built upon the open-source NNPDF code and is released together with documentation, and tutorials. To illustrate the functionalities of the new tool, we present a new global analysis of the SMEFT Wilson coefficients accounting for their interplay with the PDFs. We increment our previous analysis of the LHC Run II top quark data with both (i) the Higgs production and decay rates data from the LHC, and (ii) the precision electroweak and diboson measurements from LEP and the LHC.


title: AONeuS: A Neural Rendering Framework for Acoustic-Optical Sensor Fusion

abstract: Underwater perception and 3D surface reconstruction are challenging problems with broad applications in construction, security, marine archaeology, and environmental monitoring. Treacherous operating conditions, fragile surroundings, and limited navigation control often dictate that submersibles restrict their range of motion and, thus, the baseline over which they can capture measurements. In the context of 3D scene reconstruction, it is well-known that smaller baselines make reconstruction more challenging. Our work develops a physics-based multimodal acoustic-optical neural surface reconstruction framework (AONeuS) capable of effectively integrating high-resolution RGB measurements with low-resolution depth-resolved imaging sonar measurements. By fusing these complementary modalities, our framework can reconstruct accurate high-resolution 3D surfaces from measurements captured over heavily-restricted baselines. Through extensive simulations and in-lab experiments, we demonstrate that AONeuS dramatically outperforms recent RGB-only and sonar-only inverse-differentiable-rendering--based surface reconstruction methods. A website visualizing the results of our paper is located at this address: https://aoneus.github.io/


title: V-IRL: Grounding Virtual Intelligence in Real Life

abstract: There is a sensory gulf between the Earth that humans inhabit and the digital realms in which modern AI agents are created. To develop AI agents that can sense, think, and act as flexibly as humans in real-world settings, it is imperative to bridge the realism gap between the digital and physical worlds. How can we embody agents in an environment as rich and diverse as the one we inhabit, without the constraints imposed by real hardware and control? Towards this end, we introduce V-IRL: a platform that enables agents to scalably interact with the real world in a virtual yet realistic environment. Our platform serves as a playground for developing agents that can accomplish various practical tasks and as a vast testbed for measuring progress in capabilities spanning perception, decision-making, and interaction with real-world data across the entire globe.


title: HASSOD: Hierarchical Adaptive Self-Supervised Object Detection

abstract: The human visual perception system demonstrates exceptional capabilities in learning without explicit supervision and understanding the part-to-whole composition of objects. Drawing inspiration from these two abilities, we propose Hierarchical Adaptive Self-Supervised Object Detection (HASSOD), a novel approach that learns to detect objects and understand their compositions without human supervision. HASSOD employs a hierarchical adaptive clustering strategy to group regions into object masks based on self-supervised visual representations, adaptively determining the number of objects per image. Furthermore, HASSOD identifies the hierarchical levels of objects in terms of composition, by analyzing coverage relations between masks and constructing tree structures. This additional self-supervised learning task leads to improved detection performance and enhanced interpretability. Lastly, we abandon the inefficient multi-round self-training process utilized in prior methods and instead adapt the Mean Teacher framework from semi-supervised learning, which leads to a smoother and more efficient training process. Through extensive experiments on prevalent image datasets, we demonstrate the superiority of HASSOD over existing methods, thereby advancing the state of the art in self-supervised object detection. Notably, we improve Mask AR from 20.2 to 22.5 on LVIS, and from 17.0 to 26.0 on SA-1B. Project page: https://HASSOD-NeurIPS23.github.io.


title: Test-Time Adaptation for Depth Completion

abstract: It is common to observe performance degradation when transferring models trained on some (source) datasets to target testing data due to a domain gap between them. Existing methods for bridging this gap, such as domain adaptation (DA), may require the source data on which the model was trained (often not available), while others, i.e., source-free DA, require many passes through the testing data. We propose an online test-time adaptation method for depth completion, the task of inferring a dense depth map from a single image and associated sparse depth map, that closes the performance gap in a single pass. We first present a study on how the domain shift in each data modality affects model performance. Based on our observations that the sparse depth modality exhibits a much smaller covariate shift than the image, we design an embedding module trained in the source domain that preserves a mapping from features encoding only sparse depth to those encoding image and sparse depth. During test time, sparse depth features are projected using this map as a proxy for source domain features and are used as guidance to train a set of auxiliary parameters (i.e., adaptation layer) to align image and sparse depth features from the target test domain to that of the source domain. We evaluate our method on indoor and outdoor scenarios and show that it improves over baselines by an average of 21.1%.


title: The Globalization of Science: The Increasing Power of Individual Scientists

abstract: National science systems have become embedded in global science and countries do everything they can to harness global knowledge to national economic needs. However, accessing and using the riches of global knowledge can occur only through scientists. Consequently, the research power of nations relies on the research power of individual scientists. Their capacity to collaborate internationally and to tap into the global networked science is key. The constantly evolving, bottom-up, autonomous, self-regulating, and self-focused nature of global science requires deeper understanding; and the best way to understand its dynamics is to understand what drives academic scientists in their work. The idea that science remains a state-driven rather than curiosity-driven is difficult to sustain. In empirical terms, we describe the globalization of science using selected publication, collaboration, and citation data from 2000-2020. The globalization of science implies two different processes in two different system types: the growth of science in the Western world is almost entirely attributable to internationally co-authored publications; its growth in the developing world, in contrast, is driven by both internationally co-authored and domestic publications. Global network science opens incredible opportunities to new arrivals - countries as well as institutions and research teams. The global system is embedded in the rules created by scientists themselves and maintained as a self-organizing system and nation-states have another major level to consider in their science policies: the global level. Globalization of science provides more agency, autonomy, collegiality, and self-regulation to scientists embedded in national science structures and involved in global networks.


title: Results on a Mixed Finite Element Approach for a Model Convection-Diffusion Problem

abstract: We consider a model convection-diffusion problem and present our recent numerical and analysis results regarding mixed finite element formulation and discretization in the singular perturbed case when the convection term dominates the problem. Using the concepts of optimal norm and saddle point reformulation, we found new error estimates for the case of uniform meshes. We compare the standard linear Galerkin discretization to a saddle point least square discretization that uses quadratic test functions, and explain the non-physical oscillations of the discrete solutions. We also relate a known upwinding Petrov Galerkin method and the stream-line diffusion discretization method, by emphasizing the resulting linear systems and by comparing appropriate error norms. The results can be extended to the multidimensional case in order to find efficient approximations for more general singular perturbed problems including convection dominated models


title: RTHDet: Rotate Table Area and Head Detection in images

abstract: Traditional models focus on horizontal table detection but struggle in rotating contexts, limiting progress in table recognition. This paper introduces a new task: detecting table regions and localizing head-tail parts in rotation scenarios. We propose corresponding datasets, evaluation metrics, and methods. Our novel method, 'Adaptively Bounded Rotation,' addresses dataset scarcity in detecting rotated tables and their head-tail parts. We produced 'TRR360D,' a dataset incorporating semantic information of table head and tail, based on 'ICDAR2019MTD.' A new metric, 'R360 AP,' measures precision in detecting rotated regions and localizing head-tail parts. Our baseline, the high-speed and accurate 'RTMDet-S,' is chosen after extensive review and testing. We introduce 'RTHDet,' enhancing the baseline with a 'r360' rotated rectangle angle representation and an 'Angle Loss' branch, improving head-tail localization. By applying transfer learning and adaptive boundary rotation augmentation, RTHDet's AP50 (T<90) improved from 23.7% to 88.7% compared to the baseline. This demonstrates RTHDet's effectiveness in detecting rotating table regions and accurately localizing head and tail parts.RTHDet is integrated into the widely-used open-source MMRotate toolkit: https://github.com/open-mmlab/mmrotate/tree/dev-1.x/projects/RR360.


title: Artificial Intelligence for EEG Prediction: Applied Chaos Theory

abstract: In the present research, we delve into the intricate realm of electroencephalogram (EEG) data analysis, focusing on sequence-to-sequence prediction of data across 32 EEG channels. The study harmoniously fuses the principles of applied chaos theory and dynamical systems theory to engender a novel feature set, enriching the representational capacity of our deep learning model. The endeavour's cornerstone is a transformer-based sequence-to-sequence architecture, calibrated meticulously to capture the non-linear and high-dimensional temporal dependencies inherent in EEG sequences. Through judicious architecture design, parameter initialisation strategies, and optimisation techniques, we have navigated the intricate balance between computational expediency and predictive performance. Our model stands as a vanguard in EEG data sequence prediction, demonstrating remarkable generalisability and robustness. The findings not only extend our understanding of EEG data dynamics but also unveil a potent analytical framework that can be adapted to diverse temporal sequence prediction tasks in neuroscience and beyond.


title: SpecFormer: Guarding Vision Transformer Robustness via Maximum Singular Value Penalization

abstract: Vision Transformers (ViTs) have gained prominence as a preferred choice for a wide range of computer vision tasks due to their exceptional performance. However, their widespread adoption has raised concerns about security in the face of malicious attacks. Most existing methods rely on empirical adjustments during the training process, lacking a clear theoretical foundation. In this study, we address this gap by introducing SpecFormer, specifically designed to enhance ViTs' resilience against adversarial attacks, with support from carefully derived theoretical guarantees. We establish local Lipschitz bounds for the self-attention layer and introduce a novel approach, Maximum Singular Value Penalization (MSVP), to attain precise control over these bounds. We seamlessly integrate MSVP into ViTs' attention layers, using the power iteration method for enhanced computational efficiency. The modified model, SpecFormer, effectively reduces the spectral norms of attention weight matrices, thereby enhancing network local Lipschitzness. This, in turn, leads to improved training efficiency and robustness. Extensive experiments on CIFAR and ImageNet datasets confirm SpecFormer's superior performance in defending against adversarial attacks.


title: Effective Reduced Models from Delay Differential Equations: Bifurcations, Tipping Solution Paths, and ENSO variability

abstract: Conceptual delay models have played a key role in the understanding of El Ni\~no-Southern Oscillation (ENSO) variability. Based on such delay models, we propose a novel scenario for the fabric of ENSO variability resulting from the subtle interplay between stochastic disturbances and nonlinear invariant sets emerging from bifurcations of the unperturbed dynamics. To identify these invariant sets we adopt an approach combining Galerkin-Koornwinder (GK) approximations of delay differential equations and center-unstable manifold reduction techniques. In that respect, GK approximation formulas are reviewed and synthesized, as well as analytic approximation formulas of center-unstable manifolds. The reduced systems derived thereof enable us to conduct a thorough analysis of the bifurcations arising in a standard delay model of ENSO. We identify thereby a saddle-node bifurcation of periodic orbits co-existing with a subcritical Hopf bifurcation, and a homoclinic bifurcation for this model. We show furthermore that the computation of unstable periodic orbits (UPOs) unfolding through these bifurcations is considerably simplified from the reduced systems. These dynamical insights enable us in turn to design a stochastic model whose solutions -- as the delay parameter drifts slowly through its critical values -- produce a wealth of temporal patterns resembling ENSO events and exhibiting also decadal variability. Our analysis dissects the origin of this variability and shows how it is tied to certain transition paths between invariant sets of the unperturbed dynamics (for ENSO's interannual variability) or simply due to the presence of UPOs close to the homoclinic orbit (for decadal variability). In short, this study points out the role of solution paths evolving through tipping "points" beyond equilibria, as possible mechanisms organizing the variability of certain climate phenomena.


title: Physical Reservoir Computing Enabled by Solitary Waves and Biologically-Inspired Nonlinear Transformation of Input Data

abstract: Reservoir computing (RC) systems can efficiently forecast chaotic time series using nonlinear dynamical properties of an artificial neural network of random connections. The versatility of RC systems has motivated further research on both hardware counterparts of traditional RC algorithms and more efficient RC-like schemes. Inspired by the nonlinear processes in a living biological brain and using solitary waves excited on the surface of a flowing liquid film, in this paper we experimentally validate a physical RC system that substitutes the effect of randomness for a nonlinear transformation of input data. Carrying out all operations using a microcontroller with a minimal computational power, we demonstrate that the so-designed RC system serves as a technically simple hardware counterpart to the `next-generation' improvement of the traditional RC algorithm.

categories: cs.NE cs.AI nlin.CD nlin.PS physics.flu-dyn


title: Exceptional points in transistor-metamaterial inspired transmission lines

abstract: Motivated by our recent findings in [Phys. Rev. Lett. 128, 013902, 2022], which introduces a new class of electromagnetic bulk materials whose response is similar to conventional semiconductor transistors, here we propose a one-dimensional (1D) version of such a material based on transmission lines coupled with FET isolators. We demonstrate that the response of this 1D system is nonreciprocal and non-Hermitian, analogous to the idealized transistor-metamaterial, and is also characterized by a broken time-reversal symmetry. We analyze the wave propagation in the system and find that the interaction between the eigenmodes can either lead to gain or loss depending on the propagation distance. Furthermore, it is also shown that the system may be operated at an exceptional point, wherein the response of the structure is singular, and the power gain is maximized. Finally, we demonstrate that the exceptional point coincides with the point of operation of typical microwave amplifiers, such as the distributed amplifier.


title: Territoires intelligents durables et approche multi-agents : Retour d'exp{\'e}riences de travaux men{\'e}s {\`a} l'{\^i}le de La R{\'e}union

abstract: R{\'e}union is a European island in the heart of the Indian Ocean, far from the resources of mainland France. It's an island rich in diversity, and faces a number of societal challenges. Many players are working together to support the transformation of its societal model towards one based on territorial and collective resilience. In this article, we propose to look back at the studies and experiments carried out over the last few years in La R{\'e}union by a research group working in the field of multi-agent simulation, and to use examples to show how this approach can contribute in a very concrete way to the processes of understanding and manufacturing behavioral and spatial planning models for a territory. We begin by outlining the basic principles of the multi-agent approach, then present our feedback from experiments in various fields of territorial foresight. The article concludes with a presentation of the research team's approach to forging links between stakeholders involved in territorial transformation, through the facilitation of a think-tank.


title: $\imath$Hall algebras of weighted projective lines and quantum symmetric pairs II: injectivity

abstract: We show that the morphism $\Omega$ from the $\imath$quantum loop algebra $^{\texttt{Dr}}\widetilde{\mathbf{U}}(L\mathfrak{g})$ of split type to the $\imath$Hall algebra of the weighted projective line is injective if $\mathfrak{g}$ is of finite or affine type. As a byproduct, we use the whole $\imath$Hall algebra of the cyclic quiver $C_n$ to realise the $\imath$quantum loop algebra of affine $\mathfrak{gl}_n$.


title: Portable medical devices creation technology by using the Bluetooth module

abstract: The article is devoted Bluetooth wireless personal area networks specification, which provides standard for exchanging data over short distances. It is shown how the technology has evolved and its application in the design of devices. Health Device Profile considered in details, which the main feature is the work of a medical orientation devices.


title: Requirements for a Career in Information Security: A Comprehensive Review

abstract: This research paper adopts a methodology by conducting a thorough literature review to uncover the essential prerequisites for achieving a prosperous career in the field of Information Security (IS). The primary objective is to increase public awareness regarding the diverse opportunities available in the Information Security (IS) field. The initial search involved scouring four prominent academic databases using the specific keywords "cybersecurity" and "skills," resulting in the identification of a substantial corpus of 1,520 articles. After applying rigorous screening criteria, a refined set of 31 relevant papers was selected for further analysis. Thematic analysis was conducted on these studies to identify and delineate the crucial knowledge and skills that an IS professional should possess. The research findings emphasize the significant time investment required for individuals to acquire the necessary technical proficiency in the cybersecurity domain. Furthermore, the study recognizes the existence of gender-related obstacles for women pursuing cybersecurity careers due to the field's unique requirements. It suggests that females can potentially overcome these barriers by initially entering the profession at lower levels and subsequently advancing based on individual circumstances.


title: Connect Later: Improving Fine-tuning for Robustness with Targeted Augmentations

abstract: Models trained on a labeled source domain (e.g., labeled images from wildlife camera traps) often generalize poorly when deployed on an out-of-distribution (OOD) target domain (e.g., images from new camera trap locations). In the domain adaptation setting where unlabeled target data is available, self-supervised pretraining (e.g., masked autoencoding or contrastive learning) is a promising method to mitigate this performance drop. Pretraining improves OOD error when the generic data augmentations used (e.g., masking or cropping) connect the source and target domains, which may be far apart in the input space. In this paper, we show on real-world tasks that standard fine-tuning after pretraining does not consistently improve OOD error over simply training from scratch on labeled source data. To better leverage pretraining for distribution shifts, we propose Connect Later: after pretraining with generic augmentations, fine-tune with targeted augmentations designed with knowledge of the distribution shift. Pretraining learns good representations within the source and target domains, while targeted augmentations connect the domains better during fine-tuning. Connect Later improves average OOD error over standard fine-tuning and supervised learning with targeted augmentations on 4 real-world datasets: Connect Later achieves the state-of-the-art on astronomical time-series classification (AstroClassification) by 2.5%, wildlife species identification (iWildCam-WILDS) with ResNet-50 by 0.9%, and tumor identification (Camelyon17-WILDS) with DenseNet121 by 1.1%; as well as best performance on a new dataset for astronomical time-series redshift prediction (Redshifts) by 0.03 RMSE (11% relative). Code and datasets are available at https://github.com/helenqu/connect-later.


title: Slot Structured World Models

abstract: The ability to perceive and reason about individual objects and their interactions is a goal to be achieved for building intelligent artificial systems. State-of-the-art approaches use a feedforward encoder to extract object embeddings and a latent graph neural network to model the interaction between these object embeddings. However, the feedforward encoder can not extract {\it object-centric} representations, nor can it disentangle multiple objects with similar appearance. To solve these issues, we introduce {\it Slot Structured World Models} (SSWM), a class of world models that combines an {\it object-centric} encoder (based on Slot Attention) with a latent graph-based dynamics model. We evaluate our method in the Spriteworld benchmark with simple rules of physical interaction, where Slot Structured World Models consistently outperform baselines on a range of (multi-step) prediction tasks with action-conditional object interactions. All code to reproduce paper experiments is available from \url{https://github.com/JonathanCollu/Slot-Structured-World-Models}.


title: Uni3D-LLM: Unifying Point Cloud Perception, Generation and Editing with Large Language Models

abstract: In this paper, we introduce Uni3D-LLM, a unified framework that leverages a Large Language Model (LLM) to integrate tasks of 3D perception, generation, and editing within point cloud scenes. This framework empowers users to effortlessly generate and modify objects at specified locations within a scene, guided by the versatility of natural language descriptions. Uni3D-LLM harnesses the expressive power of natural language to allow for precise command over the generation and editing of 3D objects, thereby significantly enhancing operational flexibility and controllability. By mapping point cloud into the unified representation space, Uni3D-LLM achieves cross-application functionality, enabling the seamless execution of a wide array of tasks, ranging from the accurate instantiation of 3D objects to the diverse requirements of interactive design. Through a comprehensive suite of rigorous experiments, the efficacy of Uni3D-LLM in the comprehension, generation, and editing of point cloud has been validated. Additionally, we have assessed the impact of integrating a point cloud perception module on the generation and editing processes, confirming the substantial potential of our approach for practical applications.


title: Visual Enumeration is Challenging for Large-scale Generative AI

abstract: Humans can readily judge the number of objects in a visual scene, even without counting, and such a skill has been documented in many animal species and babies prior to language development and formal schooling. Numerical judgments are error-free for small sets, while for larger collections responses become approximate, with variability increasing proportionally to the target number. This response pattern is observed for items of all kinds, despite variation in object features (such as color or shape), suggesting that our visual number sense relies on abstract representations of numerosity. Here, we investigate whether large-scale generative Artificial Intelligence (AI) systems have a human-like number sense, which should allow them to reliably name the number of objects in simple visual stimuli or generate images containing a target number of items in the 1-10 range. Surprisingly, most of the foundation models considered have a poor number sense: They make striking errors even with small numbers, the response variability does not increase in a systematic way, and the pattern of errors depends on object category. Only the most recent proprietary systems exhibit signatures of a visual number sense. Our findings demonstrate that having an intuitive visual understanding of number remains challenging for foundation models, which in turn might be detrimental to the perceptual grounding of numeracy that in humans is crucial for mathematical learning.


title: Unsupervised Salient Patch Selection for Data-Efficient Reinforcement Learning

abstract: To improve the sample efficiency of vision-based deep reinforcement learning (RL), we propose a novel method, called SPIRL, to automatically extract important patches from input images. Following Masked Auto-Encoders, SPIRL is based on Vision Transformer models pre-trained in a self-supervised fashion to reconstruct images from randomly-sampled patches. These pre-trained models can then be exploited to detect and select salient patches, defined as hard to reconstruct from neighboring patches. In RL, the SPIRL agent processes selected salient patches via an attention module. We empirically validate SPIRL on Atari games to test its data-efficiency against relevant state-of-the-art methods, including some traditional model-based methods and keypoint-based models. In addition, we analyze our model's interpretability capabilities.


title: Calabi-Yau categories and graded quivers with potential

abstract: We prove that the equivalence classes of d-dimensional Calabi-Yau $A_\infty$-categories (dCY category for short) of certain type are in one-to-one correspondence with the gauge equivalence classes of graded quivers with potential.


title: Theory of sectorial operators and its application in Fractional calculus

abstract: In this monograph, we formulated the sufficient conditions of the Abel-Lidskii basis property for a sectorial operator. Having studied such an operator class, we strengthened the conditions regarding the semi-angle of the sector and weakened a great deal conditions regarding the involved parameters. Thus, we clarified the results by Lidskii V.B. devoted to the decomposition on the root vector system of the non-selfadjoint operator. We used a technique of the entire function theory and introduced the so-called Schatten-von Neumann class of the convergence exponent. Having considered strictly accretive operators satisfying special conditions formulated in terms of the norm and used a sequence of contours of the power type, we invented a peculiar method how to calculate a contour integral involved in the problem. Finally, we consider evolution equations in the abstract Hilbert space.


title: Cyclic Neural Network

abstract: This paper answers a fundamental question in artificial neural network (ANN) design: We do not need to build ANNs layer-by-layer sequentially to guarantee the Directed Acyclic Graph (DAG) property. Drawing inspiration from biological intelligence (BI), where neurons form a complex, graph-structured network, we introduce the groundbreaking Cyclic Neural Networks (Cyclic NNs). It emulates the flexible and dynamic graph nature of biological neural systems, allowing neuron connections in any graph-like structure, including cycles. This offers greater adaptability compared to the DAG structure of current ANNs. We further develop the Graph Over Multi-layer Perceptron, which is the first detailed model based on this new design paradigm. Experimental validation of the Cyclic NN's advantages on widely tested datasets in most generalized cases, demonstrating its superiority over current BP training methods through the use of a forward-forward (FF) training algorithm. This research illustrates a totally new ANN design paradigm, which is a significant departure from current ANN designs, potentially leading to more biologically plausible AI systems.