title: Distributional Finite Element curl div Complexes and Application to Quad Curl Problems

abstract: The paper addresses the challenge of constructing conforming finite element spaces for high-order differential operators in high dimensions, with a focus on the curl div operator in three dimensions. Tangential-normal continuity is introduced in order to develop distributional finite element curl div complexes. The spaces constructed are applied to discretize a quad curl problem, demonstrating optimal order of convergence. Furthermore, a hybridization technique is proposed, demonstrating its equivalence to nonconforming finite elements and weak Galerkin methods.


title: Network-Level Integrated Sensing and Communication: Interference Management and BS Coordination Using Stochastic Geometry

abstract: In this work, we study integrated sensing and communication (ISAC) networks with the aim of effectively balancing sensing and communication (S&C) performance at the network level. Focusing on monostatic sensing, the tool of stochastic geometry is exploited to capture the S&C performance, which facilitates us to illuminate key cooperative dependencies in the ISAC network and optimize key network-level parameters. Based on the derived tractable expression of area spectral efficiency (ASE), we formulate the optimization problem to maximize the network performance from the view point of two joint S&C metrics. Towards this end, we further jointly optimize the cooperative BS cluster sizes for S&C and the serving/probing numbers of users/targets to achieve a flexible tradeoff between S&C at the network level. It is verified that interference nulling can effectively improve the average data rate and radar information rate. Surprisingly, the optimal communication tradeoff for the case of the ASE maximization tends to employ all spacial resources towards multiplexing and diversity gain, without interference nulling. By contrast, for the sensing objectives, resource allocation tends to eliminate certain interference especially when the antenna resources are sufficient, because the inter-cell interference becomes a more dominant factor affecting sensing performance. Furthermore, we prove that the ratio of the optimal number of users and the number of transmit antennas is a constant value when the communication performance is optimal. Simulation results demonstrate that the proposed cooperative ISAC scheme achieves a substantial gain in S&C performance at the network level.


title: Assessing Knowledge Editing in Language Models via Relation Perspective

abstract: Knowledge Editing (KE) for modifying factual knowledge in Large Language Models (LLMs) has been receiving increasing attention. However, existing knowledge editing methods are entity-centric, and it is unclear whether this approach is suitable for a relation-centric perspective. To address this gap, this paper constructs a new benchmark named RaKE, which focuses on Relation based Knowledge Editing. In this paper, we establish a suite of innovative metrics for evaluation and conduct comprehensive experiments involving various knowledge editing baselines. We notice that existing knowledge editing methods exhibit the potential difficulty in their ability to edit relations. Therefore, we further explore the role of relations in factual triplets within the transformer. Our research results confirm that knowledge related to relations is not only stored in the FFN network but also in the attention layers. This provides experimental support for future relation-based knowledge editing methods.


title: On the Crazy Knight's Tour Problem

abstract: Heffter arrays are partially filled arrays that have been introduced in [1] as a tool to construct regular embeddings of graphs on surfaces. These constructions can be achieved from the solution of a tour problem on the filled cells of the array, introduced in [3] and called Crazy Knight's Tour Problem. In particular, the knight's move is seen as the composition of an horizontal move and a vertical one, where the directions (leftward or rightward, upward or downward respectively) are prescribed in advance for each row and each column of the array and each filled cell is mapped to the first filled cell encountered along that direction. Then, a solution to the Crazy Knight's Tour Problem is a set of directions such that the resulting move function is a tour over the array. Here, we consider a particular class of square arrays, and we construct solutions to the tour problem in some infinite families of these arrays.


title: Electronic structure in a transition metal dipnictide TaAs2

abstract: The family of transition metal dipnictides (TMDs) has been of theoretical and experimental interest because this family hosts topological states and extremely large magnetoresistance (MR). Recently, TaAs2, a member of this family, has been predicted to support a topological crystalline insulating state. Here, by using high resolution. Angle resolved photoemission spectroscopy (ARPES), we reveal both closed and open pockets in the metallic Fermi surface and linearly dispersive bands on the (201) surface, along with the presence of extreme MR observed from magneto-transport measurements. A comparison of the ARPES results with first-principles computations show that the linearly dispersive bands on the measured surface of TaAs2 are trivial bulk bands. The absence of symmetry-protected surface state on the (201) surface indicates its topologically dark nature. The presence of open Fermi surface features suggests that the open orbit fermiology could contribute to the extremely large MR of TaAs.


title: Range-Visual-Inertial Sensor Fusion for Micro Aerial Vehicle Localization and Navigation

abstract: We propose a fixed-lag smoother-based sensor fusion architecture to leverage the complementary benefits of range-based sensors and visual-inertial odometry (VIO) for localization. We use two fixed-lag smoothers (FLS) to decouple accurate state estimation and high-rate pose generation for closed-loop control. The first FLS combines ultrawideband (UWB)-based range measurements and VIO to estimate the robot trajectory and any systematic biases that affect the range measurements in cluttered environments. The second FLS estimates smooth corrections to VIO to generate pose estimates at a high rate for online control. The proposed method is lightweight and can run on a computationally constrained micro-aerial vehicle (MAV). We validate our approach through closed-loop flight tests involving dynamic trajectories in multiple real-world cluttered indoor environments. Our method achieves decimeter-to-sub-decimeter-level positioning accuracy using off-the-shelf sensors and decimeter-level tracking accuracy with minimally-tuned open-source controllers.


title: Ultrathick MA$_2$N$_4$(M'N) Intercalated Monolayers with Sublayer-Protected Fermi Surface Conduction States: Interconnect and Metal Contact Applications

abstract: Recent discovery of ultrathick $\mathrm{MoSi_2N_4(MoN)_n}$ monolayers open up an exciting platform to engineer 2D material properties via intercalation architecture. Here we computationally investigate a series of ultrathick MA$_2$N$_4$(M'N) monolayers (M, M' = Mo, W; A = Si, Ge) under both homolayer and heterolayer intercalation architectures in which the same and different species of transition metal nitride inner core layers are intercalated by outer passivating nitride sublayers, respectively. The MA$_2$N$_4$(M'N) monolayers are thermally, dynamically and mechanically stable with excellent mechanical strength and metallic properties. Intriguingly, the metallic states around Fermi level are localized within the inner core layers. Carrier conduction mediated by electronic states around the Fermi level is thus spatially insulated from the external environment by the native outer nitride sublayers, suggesting the potential of MA$_2$N$_4$(M'N) in back-end-of-line (BEOL) metal interconnect applications. Nitrogen vacancy defect at the outer sublayers creates `punch through' states around the Fermi level that bridges the carrier conduction in the inner core layers and the outer environment, forming a electrical contact akin to the `vias' structures of metal interconnects. We further show that MoSi$_2$N$_4$(MoN) can serve as a quasi-Ohmic contact to 2D WSe$_2$. These findings reveal the promising potential of ultrathick MA$_2$N$_4$(MN) monolayers as metal electrodes and BEOL interconnect applications.


title: Constrained Parameter Regularization

abstract: Regularization is a critical component in deep learning training, with weight decay being a commonly used approach. It applies a constant penalty coefficient uniformly across all parameters. This may be unnecessarily restrictive for some parameters, while insufficiently restricting others. To dynamically adjust penalty coefficients for different parameter groups, we present constrained parameter regularization (CPR) as an alternative to traditional weight decay. Instead of applying a single constant penalty to all parameters, we enforce an upper bound on a statistical measure (e.g., the L$_2$-norm) of parameter groups. Consequently, learning becomes a constraint optimization problem, which we address by an adaptation of the augmented Lagrangian method. CPR only requires two hyperparameters and incurs no measurable runtime overhead. Additionally, we propose a simple but efficient mechanism to adapt the upper bounds during the optimization. We provide empirical evidence of CPR's efficacy in experiments on the "grokking" phenomenon, computer vision, and language modeling tasks. Our results demonstrate that CPR counteracts the effects of grokking and consistently matches or outperforms traditional weight decay.


title: X-ray Free-Electron Laser accelerator to study on Quantum Electro-Dynamics

abstract: X-ray free-electron lasers (XFELs) utilize high-density and high-energy electron bunches which are well-suited to produce Compton back-scattering radiation. Here we study study interaction of such electron bunches during head-on collision with retroreflected X-ray pulses, emitted by an XFEL. Such collisions allow one to conduct experiments on electron-positron pair production, both through trident and gamma-gamma colliding processes. We discuss cost-effective setups to study such processes, taking advantage of the existing conventional as well as proposed X-ray FEL infrastructure. We estimate parameters of the proposed experiments and compare them with other projects under construction.


title: Do Localization Methods Actually Localize Memorized Data in LLMs? A Tale of Two Benchmarks

abstract: The concept of localization in LLMs is often mentioned in prior work; however, methods for localization have never been systematically and directly evaluated. We propose two complementary benchmarks that evaluate the ability of localization methods to pinpoint LLM components responsible for memorized data. In our INJ benchmark, we actively inject a piece of new information into a small subset of LLM weights, enabling us to directly evaluate whether localization methods can identify these "ground truth" weights. In our DEL benchmark, we evaluate localization by measuring how much dropping out identified neurons deletes a memorized pretrained sequence. Despite their different perspectives, our two benchmarks yield consistent rankings of five localization methods. Methods adapted from network pruning perform well on both benchmarks, and all evaluated methods show promising localization ability. On the other hand, even successful methods identify neurons that are not specific to a single memorized sequence.


title: Automatic cable harness layout routing in a customizable 3D environment

abstract: Designing cable harnesses can be time-consuming and complex due to many design and manufacturing aspects and rules. Automating the design process can help to fulfil these rules, speed up the process, and optimize the design. To accommodate this, we formulate a harness routing optimization problem to minimize cable lengths, maximize bundling by rewarding shared paths, and optimize the cables' spatial location with respect to case-specific information of the routing environment, e.g., zones to avoid. A deterministic and computationally effective cable harness routing algorithm has been developed to solve the routing problem and is used to generate a set of cable harness topology candidates and approximate the Pareto front. Our approach was tested against a stochastic and an exact solver and our routing algorithm generated objective function values better than the stochastic approach and close to the exact solver. Our algorithm was able to find solutions, some of them being proven to be near-optimal, for three industrial-sized 3D cases within reasonable time (in magnitude of seconds to minutes) and the computation times were comparable to those of the stochastic approach.


title: Brain Functional Connectivity under Teleoperation Latency: a fNIRS Study

abstract: Objective: This study aims to understand the cognitive impact of latency in teleoperation and the related mitigation methods, using functional Near-Infrared Spectroscopy (fNIRS) to analyze functional connectivity. Background: Latency between command, execution, and feedback in teleoperation can impair performance and affect operators mental state. The neural underpinnings of these effects are not well understood. Method: A human subject experiment (n = 41) of a simulated remote robot manipulation task was performed. Three conditions were tested: no latency, with visual and haptic latency, with visual latency and no haptic latency. fNIRS and performance data were recorded and analyzed. Results: The presence of latency in teleoperation significantly increased functional connectivity within and between prefrontal and motor cortexes. Maintaining visual latency while providing real-time haptic feedback reduced the average functional connectivity in all cortical networks and showed a significantly different connectivity ratio within prefrontal and motor cortical networks. The performance results showed the worst performance in the all-delayed condition and best performance in no latency condition, which echoes the neural activity patterns. Conclusion: The study provides neurological evidence that latency in teleoperation increases cognitive load, anxiety, and challenges in motion planning and control. Real-time haptic feedback, however, positively influences neural pathways related to cognition, decision-making, and sensorimotor processes. Application: This research can inform the design of ergonomic teleoperation systems that mitigate the effects of latency.


title: Rotational spectroscopic characterisation of the [D2,C,S] system: an update from the laboratory and theory

abstract: The synergy between high-resolution rotational spectroscopy and quantum-chemical calculations is essential for exploring future detection of molecules, especially when spectroscopy parameters are not available yet. By using highly correlated ab initio quartic force fields (QFFs) from explicitly correlated coupled cluster theory, a complete set of rotational constants and centrifugal distortion constants for D$_2$CS and cis/trans-DCSD isomers have been produced. Comparing our new ab initio results for D$_2$CS with new rotational spectroscopy laboratory data for the same species, the accuracy of the computed B and C rotational constants is within 0.1% while the A constant is only slightly higher. Additionally, quantum chemical vibrational frequencies are also provided, and these spectral reference data and new experimental rotational lines will provide additional references for potential observation of these deuterated sulfur species with either ground-based radio telescopes or space-based infrared observatories.


title: Imagine the Unseen World: A Benchmark for Systematic Generalization in Visual World Models

abstract: Systematic compositionality, or the ability to adapt to novel situations by creating a mental model of the world using reusable pieces of knowledge, remains a significant challenge in machine learning. While there has been considerable progress in the language domain, efforts towards systematic visual imagination, or envisioning the dynamical implications of a visual observation, are in their infancy. We introduce the Systematic Visual Imagination Benchmark (SVIB), the first benchmark designed to address this problem head-on. SVIB offers a novel framework for a minimal world modeling problem, where models are evaluated based on their ability to generate one-step image-to-image transformations under a latent world dynamics. The framework provides benefits such as the possibility to jointly optimize for systematic perception and imagination, a range of difficulty levels, and the ability to control the fraction of possible factor combinations used during training. We provide a comprehensive evaluation of various baseline models on SVIB, offering insight into the current state-of-the-art in systematic visual imagination. We hope that this benchmark will help advance visual systematic compositionality.


title: Damped Proximal Augmented Lagrangian Method for weakly-Convex Problems with Convex Constraints

abstract: We give a damped proximal augmented Lagrangian method (DPALM) for solving problems with a weakly-convex objective and convex linear/nonlinear constraints. Instead of taking a full stepsize, DPALM adopts a damped dual stepsize to ensure the boundedness of dual iterates. We show that DPALM can produce a (near) $\vareps$-KKT point within $O(\vareps^{-2})$ outer iterations if each DPALM subproblem is solved to a proper accuracy. In addition, we establish overall iteration complexity of DPALM when the objective is either a regularized smooth function or in a regularized compositional form. For the former case, DPALM achieves the complexity of $\widetilde{\mathcal{O}}\left(\varepsilon^{-2.5} \right)$ to produce an $\varepsilon$-KKT point by applying an accelerated proximal gradient (APG) method to each DPALM subproblem. For the latter case, the complexity of DPALM is $\widetilde{\mathcal{O}}\left(\varepsilon^{-3} \right)$ to produce a near $\varepsilon$-KKT point by using an APG to solve a Moreau-envelope smoothed version of each subproblem. Our outer iteration complexity and the overall complexity either generalize existing best ones from unconstrained or linear-constrained problems to convex-constrained ones, or improve over the best-known results on solving the same-structured problems. Furthermore, numerical experiments on linearly/quadratically constrained non-convex quadratic programs and linear-constrained robust nonlinear least squares are conducted to demonstrate the empirical efficiency of the proposed DPALM over several state-of-the art methods.


title: Identifying Self-Disclosures of Use, Misuse and Addiction in Community-based Social Media Posts

abstract: In the last decade, the United States has lost more than 500,000 people from an overdose involving prescription and illicit opioids making it a national public health emergency (USDHHS, 2017). Medical practitioners require robust and timely tools that can effectively identify at-risk patients. Community-based social media platforms such as Reddit allow self-disclosure for users to discuss otherwise sensitive drug-related behaviors. We present a moderate size corpus of 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use: Medical Use, Misuse, Addiction, Recovery, Relapse, Not Using. For every post, we annotate span-level extractive explanations and crucially study their role both in annotation quality and model development. We evaluate several state-of-the-art models in a supervised, few-shot, or zero-shot setting. Experimental results and error analysis show that identifying the phases of opioid use disorder is highly contextual and challenging. However, we find that using explanations during modeling leads to a significant boost in classification accuracy demonstrating their beneficial role in a high-stakes domain such as studying the opioid use disorder continuum.


title: Geometry of first nonempty Terracini loci

abstract: After a few results on curves, we characterize the smallest nonempty Terracini loci of Veronese and Segre-Veronese varieties. For del Pezzo surfaces, we give a full description of the Terracini loci. Moreover, we present an algorithm to explicitly compute the Terracini loci of a given variety.


title: Learning Fair Division from Bandit Feedback

abstract: This work addresses learning online fair division under uncertainty, where a central planner sequentially allocates items without precise knowledge of agents' values or utilities. Departing from conventional online algorithm, the planner here relies on noisy, estimated values obtained after allocating items. We introduce wrapper algorithms utilizing \textit{dual averaging}, enabling gradual learning of both the type distribution of arriving items and agents' values through bandit feedback. This approach enables the algorithms to asymptotically achieve optimal Nash social welfare in linear Fisher markets with agents having additive utilities. We establish regret bounds in Nash social welfare and empirically validate the superior performance of our proposed algorithms across synthetic and empirical datasets.


title: How Well Do Large Language Models Truly Ground?

abstract: Reliance on the inherent knowledge of Large Language Models (LLMs) can cause issues such as hallucinations, lack of control, and difficulties in integrating variable knowledge. To mitigate this, LLMs can be probed to generate responses by grounding on external context, often given as input (knowledge-augmented models). Yet, previous research is often confined to a narrow view of the term "grounding", often only focusing on whether the response contains the correct answer or not, which does not ensure the reliability of the entire response. To address this limitation, we introduce a strict definition of grounding: a model is considered truly grounded when its responses (1) fully utilize necessary knowledge from the provided context, and (2) don't exceed the knowledge within the contexts. We introduce a new dataset and a grounding metric to assess this new definition and perform experiments across 13 LLMs of different sizes and training methods to provide insights into the factors that influence grounding performance. Our findings contribute to a better understanding of how to improve grounding capabilities and suggest an area of improvement toward more reliable and controllable LLM applications.


title: Single pair of charge-two high-fold fermions with type-II van Hove singularities on the surface of ultralight chiral crystals

abstract: The realization of single-pair chiral fermions in Weyl systems remains challenging in topology physics, especially for the systems with higher chiral charges $C$. In this work, based on the symmetry analysis, low-energy effective model, and first-principles calculations, we identify the single-pair high-fold fermions in chiral cubic lattices. We first derive the minimal lattice model that exhibits a single pair of Weyl points with the opposite chiral charges of $C$ = $\pm{2}$. Furthermore, we show the ultralight chiral crystal P4$_3$32-type LiC$_2$ and its mirror enantiomer as high-quality candidate materials, which exhibit large energy windows to surmount the interruption of irrelevant bands. Since two enantiomers are connected by the mirror symmetry, we observe the opposite chiral charges $C$ and the reversal of the Fermi arc velocities, showing the correspondence of chirality in the momentum space and the real space. In addition, we also reveal type-II van Hove singularities on the helicoid surfaces, which may induce chirality-locked charge density waves on the crystal surface. Our work not only provides a promising platform for controlling the sign of topological charge through the structural chirality but also facilitates the exploration of electronic correlations on the surface of ultralight chiral crystals.


title: How Vocabulary Sharing Facilitates Multilingualism in LLaMA?

abstract: Large Language Models (LLMs), often show strong performance on English tasks, while exhibiting limitations on other languages. What is an LLM's multilingual capability when it is trained only on certain languages? The underlying mechanism remains unclear. This study endeavors to examine the multilingual capability of LLMs from the vocabulary sharing perspective by conducting an exhaustive analysis across 101 languages. Through the investigation of the performance gap before and after embedding fine-tuning, we discovered four distinct quadrants. By delving into each quadrant we provide actionable and efficient guidelines for tuning these languages. Extensive experiments reveal that existing LLMs possess multilingual capabilities that surpass our expectations, and we can significantly improve the multilingual performance of LLMs based on these attributes of each quadrant~\footnote{\url{https://github.com/CONE-MT/Vocabulary-Sharing-Facilitates-Multilingualism}.}.


title: From Trees to Polynomials and Back Again: New Capacity Bounds with Applications to TSP

abstract: We give simply exponential lower bounds on the probabilities of a given strongly Rayleigh distribution, depending only on its expectation. This resolves a weak version of a problem left open by Karlin-Klein-Oveis Gharan in their recent breakthrough work on metric TSP, and this resolution leads to a minor improvement of their approximation factor for metric TSP. Our results also allow for a more streamlined analysis of the algorithm. To achieve these new bounds, we build upon the work of Gurvits-Leake on the use of the productization technique for bounding the capacity of a real stable polynomial. This technique allows one to reduce certain inequalities for real stable polynomials to products of affine linear forms, which have an underlying matrix structure. In this paper, we push this technique further by characterizing the worst-case polynomials via bipartitioned forests. This rigid combinatorial structure yields a clean induction argument, which implies our stronger bounds. In general, we believe the results of this paper will lead to further improvement and simplification of the analysis of various combinatorial and probabilistic bounds and algorithms.


title: Lipschitz regularity of a weakly coupled vectorial almost-minimizers for the $p$-Laplacian

abstract: For a given constant $\lambda > 0$ and a bounded Lipschitz domain $D \subset \mathbb{R}^n$ ($n \geq 2$), we establish that almost-minimizers of the functional $$ J(\mathbf{v}; D) = \int_D \sum_{i=1}^{m} \left|\nabla v_i(x) \right|^p+ \lambda \chi_{\{\left|\mathbf{v} \right|>0\}} (x) \, dx, \qquad 1<p<\infty, $$ where $\mathbf{v} = (v_1, \cdots, v_m)$, and $m \in \mathbb{N}$, exhibit optimal Lipschitz continuity in compact sets of $D$. Furthermore, assuming $p \geq 2$ and employing a distinctly different methodology, we tackle the issue of boundary Lipschitz regularity for $v$. This approach simultaneously yields alternative proof for the optimal local Lipschitz regularity for the interior case.


title: Super Gromov-Witten Invariants via torus localization

abstract: In this article we propose a definition of super Gromov-Witten invariants by postulating a torus localization property for the odd directions of the moduli spaces of super stable maps and super stable curves of genus zero. That is, we define super Gromov-Witten invariants as the integral over the pullback of homology classes along the evaluation maps divided by the equivariant Euler class of the normal bundle of the embedding of the moduli space of stable spin maps into the moduli space of super stable maps. This definition sidesteps the difficulties of defining a supergeometric intersection theory and works with classical intersection theory only. The properties of the normal bundles, known from the differential geometric construction of the moduli space of super stable maps, imply that super Gromov-Witten invariants satisfy a generalization of Kontsevich-Manin axioms and allow for the construction of a super small quantum cohomology ring. We describe a method to calculate super Gromov-Witten invariants of $\mathbb{P}^n$ of genus zero by a further geometric torus localization and give explicit numbers in degree one when dimension and number of marked points are small.


title: Self-stabilizing Byzantine Multivalued Consensus

abstract: Consensus, abstracting a myriad of problems in which processes have to agree on a single value, is one of the most celebrated problems of fault-tolerant distributed computing. Consensus applications include fundamental services for the environments of the Cloud and Blockchain, and in such challenging environments, malicious behaviors are often modeled as adversarial Byzantine faults. At OPODIS 2010, Mostefaoui and Raynal (in short MR) presented a Byzantine-tolerant solution to consensus in which the decided value cannot be a value proposed only by Byzantine processes. MR has optimal resilience coping with up to t < n/3 Byzantine nodes over n processes. MR provides this multivalued consensus object (which accepts proposals taken from a finite set of values) assuming the availability of a single Binary consensus object (which accepts proposals taken from the set {0,1}). This work, which focuses on multivalued consensus, aims at the design of an even more robust solution than MR. Our proposal expands MR's fault-model with self-stabilization, a vigorous notion of fault-tolerance. In addition to tolerating Byzantine, self-stabilizing systems can automatically recover after the occurrence of arbitrary transient-faults. These faults represent any violation of the assumptions according to which the system was designed to operate (provided that the algorithm code remains intact). To the best of our knowledge, we propose the first self-stabilizing solution for intrusion-tolerant multivalued consensus for asynchronous message-passing systems prone to Byzantine failures. Our solution has a O(t) stabilization time from arbitrary transient faults.


title: Flow reconstruction and particle characterization from inertial Lagrangian tracks

abstract: This text describes a method to simultaneously reconstruct flow states and determine particle properties from Lagrangian particle tracking (LPT) data. LPT is a popular measurement strategy for fluids in which particles in a flow are illuminated, imaged (typically with multiple cameras), localized in 3D, and then tracked across a series of frames. The resultant "tracks" are spatially sparse, and a reconstruction algorithm is commonly employed to determine dense Eulerian velocity and pressure fields that are consistent with the data as well as the equations governing fluid dynamics. Existing LPT reconstruction algorithms presume that the particles perfectly follow the flow, but this assumption breaks down for inertial particles, which can exhibit lag or ballistic motion and may impart significant momentum to the surrounding fluid. We report an LPT reconstruction strategy that incorporates the transport physics of both the carrier fluid and particle phases, which may be parameterized to account for unknown particle properties like size and density. Our method enables the reconstruction of unsteady flow states and determination of particle properties from LPT data and the coupled governing equations for both phases. We use a neural solver to represent flow states and data-constrained polynomials to represent the tracks (though we note that our technique is compatible with a variety of solvers). Numerical tests are performed to demonstrate the reconstruction of forced isotropic turbulence and a cone-cylinder shock structure from inertial tracks that exhibit significant lag, streamline crossing, and preferential sampling.


title: Spiking NeRF: Representing the Real-World Geometry by a Discontinuous Representation

abstract: A crucial reason for the success of existing NeRF-based methods is to build a neural density field for the geometry representation via multiple perceptron layers (MLPs). MLPs are continuous functions, however, real geometry or density field is frequently discontinuous at the interface between the air and the surface. Such a contrary brings the problem of unfaithful geometry representation. To this end, this paper proposes spiking NeRF, which leverages spiking neurons and a hybrid Artificial Neural Network (ANN)-Spiking Neural Network (SNN) framework to build a discontinuous density field for faithful geometry representation. Specifically, we first demonstrate the reason why continuous density fields will bring inaccuracy. Then, we propose to use the spiking neurons to build a discontinuous density field. We conduct a comprehensive analysis for the problem of existing spiking neuron models and then provide the numerical relationship between the parameter of the spiking neuron and the theoretical accuracy of geometry. Based on this, we propose a bounded spiking neuron to build the discontinuous density field. Our method achieves SOTA performance. The source code and the supplementary material are available at https://github.com/liaozhanfeng/Spiking-NeRF.


title: Majority dynamics on random graphs: the multiple states case

abstract: We study the evolution of majority dynamics with more than two states on the binomial random graph $G(n,p)$. In this process, each vertex has a state in $\{1,\ldots, k\}$, with $k\geq 3$, and at each round every vertex adopts state $i$ if it has more neighbours in state $i$ that in any other state. Ties are resolved randomly. We show that with high probability the process reaches unanimity in at most three rounds, if $np\gg n^{2/3}$.


title: The Discovery of 63 Giant Radio Galaxies in the FIRST Survey

abstract: Giant Radio Galaxies (GRGs) are Active Galactic Nuclei (AGN) with radio emission that extends over projected sizes $>0.7\,$Mpc. The large angular sizes associated with GRGs complicate their identification in radio survey images using traditional source finders. In this Note, we use DRAGNhunter, an algorithm designed to find double-lobed radio galaxies, to search for GRGs in the Faint Images of the Radio Sky at Twenty cm survey (FIRST). Radio and optical images of identified candidates are visually inspected to confirm their authenticity, resulting in the discovery of $63$ previously unreported GRGs.


title: Soliton approximation in continuum models of leader-follower behavior

abstract: Complex biological processes involve collective behavior of entities (bacteria, cells, animals) over many length and time scales and can be described by discrete models that track individuals or by continuum models involving densities and fields. We consider hybrid stochastic agent-based models of branching morphogenesis and angiogenesis (new blood vessel creation from pre-existing vasculature), which treat cells as individuals that are guided by underlying continuous chemical and/or mechanical fields. In these descriptions, leader (tip) cells emerge from existing branches and follower (stalk) cells build the new sprout in their wake. Vessel branching and fusion (anastomosis) occur as a result of tip and stalk cell dynamics. Coarse-graining these hybrid models in appropriate limits produces continuum partial differential equations (PDEs) for endothelial cell densities that are more analytically tractable. While these models differ in nonlinearity, they produce similar equations at leading order when chemotaxis is dominant. We analyze this leading order system in a simple quasi-one-dimensional geometry and show that the numerical solution of the leading order PDE is well described by a soliton wave that evolves from vessel to source. This wave is an attractor for intermediate times until it arrives at the hypoxic region releasing the growth factor. The mathematical techniques used here thus identify common features of discrete and continuum approaches and provide insight into general biological mechanisms governing their collective dynamics.

categories: cond-mat.soft math-ph math.MP nlin.PS physics.bio-ph physics.med-ph


title: Posterior accuracy and calibration under misspecification in Bayesian generalized linear models

abstract: Generalized linear models (GLMs) are popular for data-analysis in almost all quantitative sciences, but the choice of likelihood family and link function is often difficult. This motivates the search for likelihoods and links that minimize the impact of potential misspecification. We perform a large-scale simulation study on double-bounded and lower-bounded response data where we systematically vary both true and assumed likelihoods and links. In contrast to previous studies, we also study posterior calibration and uncertainty metrics in addition to point-estimate accuracy. Our results indicate that certain likelihoods and links can be remarkably robust to misspecification, performing almost on par with their respective true counterparts. Additionally, normal likelihood models with identity link (i.e., linear regression) often achieve calibration comparable to the more structurally faithful alternatives, at least in the studied scenarios. On the basis of our findings, we provide practical suggestions for robust likelihood and link choices in GLMs.


title: Effects of rotation and surface forcing on deep stellar convection zones

abstract: The canonical undestanding of stellar convection has recently been put under doubt due to helioseismic results and global 3D convection simulations. This "convective conundrum" is manifested by much higher velocity amplitudes in simulations at large scales in comparison to helioseismic results, and the difficulty in reproducing the solar differential rotation and dynamo with global 3D simulations. Here some aspects of this conundrum are discussed from the viewpoint of hydrodynamic Cartesian 3D simulations targeted at testing the rotational influence and surface forcing on deep convection. More specifically, the dominant scale of convection and the depths of the convection zone and the weakly subadiabatic -- yet convecting -- Deardorff zone are discussed in detail.


title: Structural Advantages for Integrated Builders in MEV-Boost

abstract: Currently, over 90% of Ethereum blocks are built using MEV-Boost, an auction that allows validators to sell their block-building power to builders who compete in an open English auction in each slot. Shortly after the merge, when MEV-Boost was in its infancy, most block builders were neutral, meaning they did not trade themselves but rather aggregated transactions from other traders. Over time, integrated builders, operated by trading firms, began to overtake many of the neutral builders. Outside of the integrated builder teams, little is known about which advantages integration confers beyond latency and how latency advantages distort on-chain trading. This paper explores these poorly understood advantages. We make two contributions. First, we point out that integrated builders are able to bid truthfully in their own bundle merge and then decide how much profit to take later in the final stages of the PBS auction when more information is available, making the auction for them look closer to a second-price auction while independent searchers are stuck in a first-price auction. Second, we find that latency disadvantages convey a winner's curse on slow bidders when underlying values depend on a stochastic price process that change as bids are submitted.


title: Contrastive Transformer Learning with Proximity Data Generation for Text-Based Person Search

abstract: Given a descriptive text query, text-based person search (TBPS) aims to retrieve the best-matched target person from an image gallery. Such a cross-modal retrieval task is quite challenging due to significant modality gap, fine-grained differences and insufficiency of annotated data. To better align the two modalities, most existing works focus on introducing sophisticated network structures and auxiliary tasks, which are complex and hard to implement. In this paper, we propose a simple yet effective dual Transformer model for text-based person search. By exploiting a hardness-aware contrastive learning strategy, our model achieves state-of-the-art performance without any special design for local feature alignment or side information. Moreover, we propose a proximity data generation (PDG) module to automatically produce more diverse data for cross-modal training. The PDG module first introduces an automatic generation algorithm based on a text-to-image diffusion model, which generates new text-image pair samples in the proximity space of original ones. Then it combines approximate text generation and feature-level mixup during training to further strengthen the data diversity. The PDG module can largely guarantee the reasonability of the generated samples that are directly used for training without any human inspection for noise rejection. It improves the performance of our model significantly, providing a feasible solution to the data insufficiency problem faced by such fine-grained visual-linguistic tasks. Extensive experiments on two popular datasets of the TBPS task (i.e., CUHK-PEDES and ICFG-PEDES) show that the proposed approach outperforms state-of-the-art approaches evidently, e.g., improving by 3.88%, 4.02%, 2.92% in terms of Top1, Top5, Top10 on CUHK-PEDES. The codes will be available at https://github.com/HCPLab-SYSU/PersonSearch-CTLG


title: Applications of $L^p-L^q$ estimates for solutions to semi-linear $\sigma$-evolution equations with general double damping

abstract: In this paper, we would like to study the linear Cauchy problems for semi-linear $\sigma$-evolution models with mixing a parabolic like damping term corresponding to $\sigma_1 \in [0,\sigma/2)$ and a $\sigma$-evolution like damping corresponding to $\sigma_2 \in (\sigma/2,\sigma]$. The main goals are on the one hand to conclude some estimates for solutions and their derivatives in $L^q$ setting, with any $q\in [1,\infty]$, by developing the theory of modified Bessel functions effectively to control oscillating integrals appearing the solution representation formula in a competition between these two kinds of damping. On the other hand, we are going to prove the global (in time) existence of small data Sobolev solutions in the treatment of the corresponding semi-linear equations by applying $(L^{m}\cap L^{q})- L^{q}$ and $L^{q}- L^{q}$ estimates, with $q\in (1,\infty)$ and $m\in [1,q)$, from the linear models. Finally, some further generalizations will be discussed in the end of this paper.


title: The Uli Dataset: An Exercise in Experience Led Annotation of oGBV

abstract: Online gender based violence has grown concomitantly with adoption of the internet and social media. Its effects are worse in the Global majority where many users use social media in languages other than English. The scale and volume of conversations on the internet has necessitated the need for automated detection of hate speech, and more specifically gendered abuse. There is, however, a lack of language specific and contextual data to build such automated tools. In this paper we present a dataset on gendered abuse in three languages- Hindi, Tamil and Indian English. The dataset comprises of tweets annotated along three questions pertaining to the experience of gender abuse, by experts who identify as women or a member of the LGBTQIA community in South Asia. Through this dataset we demonstrate a participatory approach to creating datasets that drive AI systems.


title: Orbital degree of freedom in high entropy oxides

abstract: The spin, charge, and lattice degrees of freedom and their interplay in high entropy oxides were intensively investigated in recent years. However, how the orbital degree of freedom is affected by the extreme disorder in high entropy oxides hasn't been studied. In this work, using perovskite structured \textit{R}VO$_3$ as a materials playground, we report how the disorder arising from mixing different rare earth ions at the rare earth site affects the orbital ordering of V$^{3+}$ t$_{2g}$-electrons. Since each member of \textit{R}VO$_3$ crystallizes into the same orthorhombic \textit{Pbnm} structure, the configurational entropy should not be critical for the success synthesis of (\textit{R}$_1$,...,\textit{R}$_n$)VO$_3$. The spin and orbital ordering was studied by measuring magnetic properties and specific heat of single crystals. Rather than the number and type of rare earth ions, the average ionic radius and size variance are the key factors determining the spin and orbital order in (\textit{R}$_1$,...,\textit{R}$_n$)VO$_3$. When the size variance is small, the average ionic radius takes precedence in dictating spin and orbital order. Increasing size variance suppresses the G-type orbital order and C-type magnetic order but favors the C-OO/G-AF state and the spin-orbital entanglement. These findings suggest that the extreme disorder introduced by mixing multiple rare earth ions in high entropy perovskites might be employed to preserve the orbital degree of freedom to near the magnetic ordering temperature, which is necessary for the electronic driven orbital ordering in a Kugel-Khomskii compound.


title: Co-ML: Collaborative Machine Learning Model Building for Developing Dataset Design Practices

abstract: Machine learning (ML) models are fundamentally shaped by data, and building inclusive ML systems requires significant considerations around how to design representative datasets. Yet, few novice-oriented ML modeling tools are designed to foster hands-on learning of dataset design practices, including how to design for data diversity and inspect for data quality. To this end, we outline a set of four data design practices (DDPs) for designing inclusive ML models and share how we designed a tablet-based application called Co-ML to foster learning of DDPs through a collaborative ML model building experience. With Co-ML, beginners can build image classifiers through a distributed experience where data is synchronized across multiple devices, enabling multiple users to iteratively refine ML datasets in discussion and coordination with their peers. We deployed Co-ML in a 2-week-long educational AIML Summer Camp, where youth ages 13-18 worked in groups to build custom ML-powered mobile applications. Our analysis reveals how multi-user model building with Co-ML, in the context of student-driven projects created during the summer camp, supported development of DDPs including incorporating data diversity, evaluating model performance, and inspecting for data quality. Additionally, we found that students' attempts to improve model performance often prioritized learnability over class balance. Through this work, we highlight how the combination of collaboration, model testing interfaces, and student-driven projects can empower learners to actively engage in exploring the role of data in ML systems.


title: On the mass and wind luminosity of young Galactic open clusters in Gaia DR2

abstract: Context. Star clusters constitute a relevant part of the stellar population in our Galaxy. The feedback processes they exert on the interstellar medium impact multiple physical processes, from the chemical to the dynamical evolution of the Galaxy. In addition, young and massive stellar clusters might act as efficient particle accelerators, possibly contributing to the production of cosmic rays. Aims. We aim at evaluating the wind luminosity driven by the young (< 30 Myr) Galactic open stellar clusters observed by the Gaia space mission, which is crucial to determine the energy channeled into accelerated particles. Methods. To this extent, we develop a method relying on the number, magnitude and line-of-sight extinction of the stars observed per cluster. Assuming that the stellar mass function follows a Kroupa mass distribution, and accounting for the maximum stellar mass allowed by both the parent cluster age and mass, we conservatively estimate the mass and wind luminosity of 387 local clusters within the second data release of Gaia. Results. We compare the results of our computation with recent estimations of young cluster masses. With respect to these, we provide a sample three times more abundant, particularly above a few thousand solar masses, which is of the utmost relevance for predicting the gamma-ray emission resulting from the interaction of accelerated particles. In fact, the cluster wind luminosity distribution we obtain is found to extend up to 3 x 10^38 erg/s, a promising feature in terms of potential particle acceleration scenarios.


title: Social Bias Probing: Fairness Benchmarking for Language Models

abstract: While the impact of social biases in language models has been recognized, prior methods for bias evaluation have been limited to binary association tests on small datasets, limiting our understanding of bias complexities. This paper proposes a novel framework for probing language models for social biases by assessing disparate treatment, which involves treating individuals differently according to their affiliation with a sensitive demographic group. We curate SOFA, a large-scale benchmark designed to address the limitations of existing fairness collections. SOFA expands the analysis beyond the binary comparison of stereotypical versus anti-stereotypical identities to include a diverse range of identities and stereotypes. Comparing our methodology with existing benchmarks, we reveal that biases within language models are more nuanced than acknowledged, indicating a broader scope of encoded biases than previously recognized. Benchmarking LMs on SOFA, we expose how identities expressing different religions lead to the most pronounced disparate treatments across all models. Finally, our findings indicate that real-life adversities faced by various groups such as women and people with disabilities are mirrored in the behavior of these models.


title: Novikov algebras and multi-indices in regularity structures

abstract: In this work, we introduce multi-Novikov algebras, a generalisation of Novikov algebras with several binary operations indexed by a given set, and show that the multi-indices recently introduced in the context of singular stochastic partial differential equations can be interpreted as free multi-Novikov algebras. This is parallel to the fact that decorated rooted trees arising in the context of regularity structures are related to free multi-pre-Lie algebras.


title: Effects of the local dynamics in the synchronization of neural models

abstract: The cooperative behavior of neurons and neuronal areas associated with the synchronization behavior proves to be a fundamental neural mechanism. In addition, abnormal levels of synchronization have been related to unhealthy neural behaviors. Throughout this thesis, it is explored different synchronization phenomena which emerge through the collective dynamics of models of neurons coupled in a network. Firstly, it is shown a strong correlation between the individual dynamics of the neuron with the global behavior of the synchronization, in which the periodicity seen in the isolated neuron is reflected in a phase synchronization in the weak coupling region. Secondly, it is studied the role of bistability in the synchronization of a network of identical neurons coupled through a mean-field scheme. It is shown that the simple existence of two distinct stable states can lead the network to different states of synchronization, depending on the initialization of the system. Lastly, it is investigated the mechanism for explosive synchronization of a complex neural network composed of non-identical neurons. The presence of this regime is accompanied by a hysteresis loop on the network dynamics as the coupling parameter is adiabatically increased and decreased. It is shown that the abrupt synchronization transitions are associated with routes to chaos. The dynamical mechanisms for the bistability region, are given in terms of a saddle-node bifurcation and a boundary crisis. Therefore, the results of this thesis show a richness of synchronization behaviors associated with small changes of the neuronal dynamics bringing new insights to the theoretical study of neural networks.


title: Applications of Computer Vision in Autonomous Vehicles: Methods, Challenges and Future Directions

abstract: Autonomous vehicle refers to a vehicle capable of perceiving its surrounding environment and driving with little or no human driver input. The perception system is a fundamental component which enables the autonomous vehicle to collect data and extract relevant information from the environment to drive safely. Benefit from the recent advances in computer vision, the perception task can be achieved by using sensors, such as camera, LiDAR, radar, and ultrasonic sensor. This paper reviews publications on computer vision and autonomous driving that are published during the last ten years. In particular, we first investigate the development of autonomous driving systems and summarize these systems that are developed by the major automotive manufacturers from different countries. Second, we investigate the sensors and benchmark data sets that are commonly utilized for autonomous driving. Then, a comprehensive overview of computer vision applications for autonomous driving such as depth estimation, object detection, lane detection, and traffic sign recognition are discussed. Additionally, we review public opinions and concerns on autonomous vehicles. Based on the discussion, we analyze the current technological challenges that autonomous vehicles meet with. Finally, we present our insights and point out some promising directions for future research. This paper will help the reader to understand autonomous vehicles from the perspectives of academia and industry.


title: Can MusicGen Create Training Data for MIR Tasks?

abstract: We are investigating the broader concept of using AI-based generative music systems to generate training data for Music Information Retrieval (MIR) tasks. To kick off this line of work, we ran an initial experiment in which we trained a genre classifier on a fully artificial music dataset created with MusicGen. We constructed over 50 000 genre- conditioned textual descriptions and generated a collection of music excerpts that covers five musical genres. Our preliminary results show that the proposed model can learn genre-specific characteristics from artificial music tracks that generalise well to real-world music recordings.


title: New Graph Decompositions and Combinatorial Boolean Matrix Multiplication Algorithms

abstract: We revisit the fundamental Boolean Matrix Multiplication (BMM) problem. With the invention of algebraic fast matrix multiplication over 50 years ago, it also became known that BMM can be solved in truly subcubic $O(n^\omega)$ time, where $\omega<3$; much work has gone into bringing $\omega$ closer to $2$. Since then, a parallel line of work has sought comparably fast combinatorial algorithms but with limited success. The naive $O(n^3)$-time algorithm was initially improved by a $\log^2{n}$ factor [Arlazarov et al.; RAS'70], then by $\log^{2.25}{n}$ [Bansal and Williams; FOCS'09], then by $\log^3{n}$ [Chan; SODA'15], and finally by $\log^4{n}$ [Yu; ICALP'15]. We design a combinatorial algorithm for BMM running in time $n^3 / 2^{\Omega(\sqrt[7]{\log n})}$ -- a speed-up over cubic time that is stronger than any poly-log factor. This comes tantalizingly close to refuting the conjecture from the 90s that truly subcubic combinatorial algorithms for BMM are impossible. This popular conjecture is the basis for dozens of fine-grained hardness results. Our main technical contribution is a new regularity decomposition theorem for Boolean matrices (or equivalently, bipartite graphs) under a notion of regularity that was recently introduced and analyzed analytically in the context of communication complexity [Kelley, Lovett, Meka; arXiv'23], and is related to a similar notion from the recent work on $3$-term arithmetic progression free sets [Kelley, Meka; FOCS'23].


title: Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization

abstract: While significant attention has been dedicated to exploiting weaknesses in LLMs through jailbreaking attacks, there remains a paucity of effort in defending against these attacks. We point out a pivotal factor contributing to the success of jailbreaks: the intrinsic conflict between the goals of being helpful and ensuring safety. Accordingly, we propose to integrate goal prioritization at both training and inference stages to counteract. Implementing goal prioritization during inference substantially diminishes the Attack Success Rate (ASR) of jailbreaking from 66.4% to 3.6% for ChatGPT. And integrating goal prioritization into model training reduces the ASR from 71.0% to 6.6% for Llama2-13B. Remarkably, even in scenarios where no jailbreaking samples are included during training, our approach slashes the ASR by half. Additionally, our findings reveal that while stronger LLMs face greater safety risks, they also possess a greater capacity to be steered towards defending against such attacks, both because of their stronger ability in instruction following. Our work thus contributes to the comprehension of jailbreaking attacks and defenses, and sheds light on the relationship between LLMs' capability and safety. Our code is available at \url{https://github.com/thu-coai/JailbreakDefense_GoalPriority}.


title: Plasma Radiation Model of Fast Radio Bursts from Magnetars

abstract: We propose a novel idea for the coherent intense millisecond radio emission of cosmic fast radio bursts (FRBs), which have recently been identified with flares from a magnetar. Motivated by the conventional paradigm of Type III solar radio bursts, we will explore the emission of coherent plasma line radiation at the electron plasma frequency and its harmonic as potential candidates of the coherent FRB emissions associated with magnetar flares. We discuss the emissions region parameters in relativistic strongly magnetized plasmas consisting of electrons, positrons and protons. The goal is to make observable predictions of this model to confront the multi-wavelength observations of FRBs from magnetars. These results will impact both observational radio astronomy and space-based astrophysics


title: Broad-Wavevector Spin Pumping of Flat-Band Magnons

abstract: We report the experimental observation of large spin pumping signals in YIG/Pt system driven by broad-wavevector spin-wave spin current. 280 nm-wide microwave inductive antennas offer broad-wavevector excitation which, in combination with quasi-flatband of YIG, allows a large number of magnons to participate in spin pumping at a given frequency. Through comparison with ferromagnetic resonance spin pumping, we attribute the enhancement of the spin current to the multichromatic magnons. The high efficiency of spin current generation enables us to uncover nontrivial propagating properties in ultra-low power regions. Additionally, our study achieves the spatially separated detection of magnons, allowing the direct extraction of the decay length. The synergistic combination of the capability of broad-wavevector excitation, enhanced voltage signals, and nonlocal detection provides a new avenue for the electrical exploration of spin waves dynamics.


title: On performance of thin-film meso-structured perovskite solar cell through experimental analysis and device simulation

abstract: In the last few years there is an unprecedented progress in the increase of the power conversion efficiency of perovskite solar cells. Evidently, further advances of the efficiency of these devices will depend on the constraints imposed by the optical and electronic properties of their constituents. Quite apparently that during the manufacturing process of a solar cell, there is an inevitable variation in the thicknesses of various functional layers, which affects the optoelectronic characteristics of the final sample. In this work a possible strategy of the analysis of the solar cell performance is suggested, based on statistically averaging procedure of experimental data. We present a case study, in which the optoelectronic properties of the meso-structured perovskite solar cell (with a mesoporous TiO$_2$ layer) are analysed within the method providing a deeper understanding of the device operation. This method enables an assessment of the overall quality of the device, pointing pathways towards the maximum efficiency design of a perovskite solar cell by material properties tuning.


title: Global Cascade of Kinetic Energy in the Ocean and the Atmospheric Imprint

abstract: We present the first estimate for the ocean's global scale-transfer of kinetic energy (KE), across scales from 10~km to 40000~km. We show the existence of oceanic KE transfer between gyre-scales and mesoscales induced by the atmosphere's Hadley, Ferrel, and polar cells, and intense downscale KE transfer associated with the Inter-Tropical Convergence Zone. We report peak upscale transfer of 300 GigaWatts across mesoscales of 120~km in size, roughly 1/3rd the energy input by winds into the oceanic general circulation. This "cascade" penetrates almost the entire water column, with nearly three quarters of it occurring south of 15$^\circ$S. The mesoscale cascade has a self-similar seasonal cycle with characteristic lag-time of $\mathbf{\approx27~}$days per octave of length-scales such that transfer across 50~km peaks in spring while transfer across 500~km peaks in summer. KE content of those mesoscales follows the same self-similar cycle but peaks $\mathbf{\approx40~}$days after the peak cascade, suggesting that energy transferred across a scale is primarily deposited at a scale 4$\times$ larger.


title: Towards A Unified View of Answer Calibration for Multi-Step Reasoning

abstract: Large Language Models (LLMs) employing Chain-of-Thought (CoT) prompting have broadened the scope for improving multi-step reasoning capabilities. We generally divide multi-step reasoning into two phases: path generation to generate the reasoning path(s); and answer calibration post-processing the reasoning path(s) to obtain a final answer. However, the existing literature lacks systematic analysis on different answer calibration approaches. In this paper, we summarize the taxonomy of recent answer calibration techniques and break them down into step-level and path-level strategies. We then conduct a thorough evaluation on these strategies from a unified view, systematically scrutinizing step-level and path-level answer calibration across multiple paths. Experimental results reveal that integrating the dominance of both strategies tends to derive optimal outcomes. Our study holds the potential to illuminate key insights for optimizing multi-step reasoning with answer calibration.


title: Implementation, performance and physics impact of particle identification at Higgs factories

abstract: This work introduces the software tool Comprehensive Particle Identification (CPID). It is a modular approach to combined PID for future Higgs factories and implemented in the Key4hep framework. Its structure is explained, the current module library laid out and initial performance measures for the ILD detector as an example presented. A basic run of CPID works already as well as the default full-simulation ILD PID reconstruction, but allows for an easy and convenient addition of more PID observables, improving PID performance in future analyses and high-level reconstruction, such as strange tagging.


title: Guided Scale Space Radon Transform for linear structures detection

abstract: Using integral transforms to the end of lines detection in images with complex background, makes the detection a hard task needing additional processing to manage the detection. As an integral transform, the Scale Space Radon Transform (SSRT) suffers from such drawbacks, even with its great abilities for thick lines detection. In this work, we propose a method to address this issue for automatic detection of thick linear structures in gray scale and binary images using the SSRT, whatever the image background content. This method involves the calculated Hessian orientations of the investigated image while computing its SSRT, in such a way that linear structures are emphasized in the SSRT space. As a consequence, the subsequent maxima detection in the SSRT space is done on a modified transform space freed from unwanted parts and, consequently, from irrelevant peaks that usually drown the peaks representing lines. Besides, highlighting the linear structure in the SSRT space permitting, thus, to efficiently detect lines of different thickness in synthetic and real images, the experiments show also the method robustness against noise and complex background.


title: Cross-view and Cross-pose Completion for 3D Human Understanding

abstract: Human perception and understanding is a major domain of computer vision which, like many other vision subdomains recently, stands to gain from the use of large models pre-trained on large datasets. We hypothesize that the most common pre-training strategy of relying on general purpose, object-centric image datasets such as ImageNet, is limited by an important domain shift. On the other hand, collecting domain-specific ground truth such as 2D or 3D labels does not scale well. Therefore, we propose a pre-training approach based on self-supervised learning that works on human-centric data using only images. Our method uses pairs of images of humans: the first is partially masked and the model is trained to reconstruct the masked parts given the visible ones and a second image. It relies on both stereoscopic (cross-view) pairs, and temporal (cross-pose) pairs taken from videos, in order to learn priors about 3D as well as human motion. We pre-train a model for body-centric tasks and one for hand-centric tasks. With a generic transformer architecture, these models outperform existing self-supervised pre-training methods on a wide set of human-centric downstream tasks, and obtain state-of-the-art performance for instance when fine-tuning for model-based and model-free human mesh recovery.


title: MAVEN-Arg: Completing the Puzzle of All-in-One Event Understanding Dataset with Event Argument Annotation

abstract: Understanding events in texts is a core objective of natural language understanding, which requires detecting event occurrences, extracting event arguments, and analyzing inter-event relationships. However, due to the annotation challenges brought by task complexity, a large-scale dataset covering the full process of event understanding has long been absent. In this paper, we introduce MAVEN-Arg, which augments MAVEN datasets with event argument annotations, making the first all-in-one dataset supporting event detection, event argument extraction (EAE), and event relation extraction. As an EAE benchmark, MAVEN-Arg offers three main advantages: (1) a comprehensive schema covering 162 event types and 612 argument roles, all with expert-written definitions and examples; (2) a large data scale, containing 98,591 events and 290,613 arguments obtained with laborious human annotation; (3) the exhaustive annotation supporting all task variants of EAE, which annotates both entity and non-entity event arguments in document level. Experiments indicate that MAVEN-Arg is quite challenging for both fine-tuned EAE models and proprietary large language models (LLMs). Furthermore, to demonstrate the benefits of an all-in-one dataset, we preliminarily explore a potential application, future event prediction, with LLMs. MAVEN-Arg and codes can be obtained from https://github.com/THU-KEG/MAVEN-Argument.


title: "We Demand Justice!": Towards Social Context Grounding of Political Texts

abstract: Social media discourse frequently consists of 'seemingly similar language used by opposing sides of the political spectrum', often translating to starkly contrasting perspectives. E.g., 'thoughts and prayers', could express sympathy for mass-shooting victims, or criticize the lack of legislative action on the issue. This paper defines the context required to fully understand such ambiguous statements in a computational setting and ground them in real-world entities, actions, and attitudes. We propose two challenging datasets that require an understanding of the real-world context of the text. We benchmark these datasets against models built upon large pre-trained models, such as RoBERTa and GPT-3. Additionally, we develop and benchmark more structured models building upon existing Discourse Contextualization Framework and Political Actor Representation models. We analyze the datasets and the predictions to obtain further insights into the pragmatic language understanding challenges posed by the proposed social grounding tasks.


title: Illness-death model with renewal

abstract: The illness-death model for chronic conditions is combined with a renewal equation for the number of newborns taking into account possibly different fertility rates in the healthy and diseased parts of the population. The resulting boundary value problem consists of a system of partial differential equations with an integral boundary condition. As an application, the boundary value problem is applied to an example about type 2 diabetes.


title: Nature of 4FGL J1838.2+3223: a flaring `spider' pulsar candidate

abstract: An unidentified $\gamma$-ray source 4FGL J1838.2+3223 has been proposed as a pulsar candidate. We present optical time-series multi-band photometry of its likely optical companion obtained with the 2.1-m telescope of Observatorio Astron\'omico Nacional San Pedro M\'artir, Mexico. The observations and the data from the Zwicky Transient Facility revealed the source brightness variability with a period of $\approx$4.02 h likely associated with the orbital motion of the binary system. The folded light curves have a single sine-like peak per period with an amplitude of about three magnitude accompanied by fast sporadic flares up to one magnitude level. We reproduce them modelling the companion heating by the pulsar. As a result, the companion side facing the pulsar is strongly heated up to 11300$\pm$400 K, while the temperature of its back side is only 2300$\pm$700 K. It has a mass of 0.10$\pm$0.05 ${\rm M}_\odot$ and underfills its Roche lobe with a filling factor of $0.60^{+0.10}_{-0.06}$. This implies that 4FGL J1838.2+3223 likely belongs to the `spider' pulsar family. The estimated distance of $\approx$3.1 kpc is compatible with Gaia results. We detect a flare from the source in X-rays and ultraviolet using Swift archival data and another one in X-rays with the eROSITA all-sky survey. Both flares have X-ray luminosity of $\sim$10$^{34}$ erg s$^{-1}$ which is two orders of magnitude higher than the upper limit in quiescence obtained from eROSITA assuming spectral shape typical for spider pulsars. If the spider interpretation is correct, these flares are among the strongest flares observed from non-accreting spider pulsars.


title: Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?

abstract: Knowledge graphs (KGs) consist of links that describe relationships between entities. Due to the difficulty of manually enumerating all relationships between entities, automatically completing them is essential for KGs. Knowledge Graph Completion (KGC) is a task that infers unseen relationships between entities in a KG. Traditional embedding-based KGC methods, such as RESCAL, TransE, DistMult, ComplEx, RotatE, HAKE, HousE, etc., infer missing links using only the knowledge from training data. In contrast, the recent Pre-trained Language Model (PLM)-based KGC utilizes knowledge obtained during pre-training. Therefore, PLM-based KGC can estimate missing links between entities by reusing memorized knowledge from pre-training without inference. This approach is problematic because building KGC models aims to infer unseen links between entities. However, conventional evaluations in KGC do not consider inference and memorization abilities separately. Thus, a PLM-based KGC method, which achieves high performance in current KGC evaluations, may be ineffective in practical applications. To address this issue, we analyze whether PLM-based KGC methods make inferences or merely access memorized knowledge. For this purpose, we propose a method for constructing synthetic datasets specified in this analysis and conclude that PLMs acquire the inference abilities required for KGC through pre-training, even though the performance improvements mostly come from textual information of entities and relations.


title: Pointwise linear separation property and infinite pointwise dense lineability

abstract: In this note we generalize a criterion within the concept of infinite dense lineability due to Calder\'on-Moreno, Gerlach-Mena and Prado-Bassas. We also introduce and explore some local notions of lineability.


title: Graph Compression with Side Information at the Decoder

abstract: In this paper, we study the problem of graph compression with side information at the decoder. The focus is on the situation when an unlabelled graph (which is also referred to as a structure) is to be compressed or is available as side information. For correlated Erd\H{o}s-R\'enyi weighted random graphs, we give a precise characterization of the smallest rate at which a labelled graph or its structure can be compressed with aid of a correlated labelled graph or its structure at the decoder. We approach this problem by using the entropy-spectrum framework and establish some convergence results for conditional distributions involving structures, which play a key role in the construction of an optimal encoding and decoding scheme. Our proof essentially uses the fact that, in the considered correlated Erd\H{o}s-R\'enyi model, the structure retains most of the information about the labelled graph. Furthermore, we consider the case of unweighted graphs and present how the optimal decoding can be done using the notion of graph alignment.


title: Caging and fluid deformations in dense bidisperse suspensions

abstract: We investigate the link between the geometric environment of particles, the local deformations of the solvent, and the bulk effective viscosity in non-Brownian suspensions. First, we discuss the caging of particles by their neighbors,and especially the caging of small particles by large ones in bidisperse suspensions.We develop a model that attributes an effective volume to particles depending on their environment, and yields the local deformations and effective viscosity. We compare this model to data from the literature, as well as to our own experiments with suspensions of non-Brownian polystyrene beads. Using dissolved polymers and their coil-stretch transition as strain probes, we measure the local deformation of the liquid and the effect of caging thereon. We obtain a linear relationship between the amplified local strain rate and the particle volume fraction, in which the critical volume fraction $\phi_\mathrm{c}$ appears as an effective volume of the particles; this relationship is found valid up into the dense regime.


title: Electroneutrality breakdown for electrolytes embedded in varying-section nanopores

abstract: We determine the local charge dynamics of a $z-z$ electrolyte embedded in a varying-section channel. By means of an expansion based on the length scale separation between the axial and transverse direction of the channel, we derive closed formulas for the local excess charge for both, dielectric and conducting walls, in $2D$ (planar geometry) as well as in $3D$ (cylindrical geometry). Our results show that, even at equilibrium, the local charge electroneutrality is broken whenever the section of the channel is not homogeneous for both dielectric and conducting walls as well as for $2D$ and $3D$ channels. Interestingly, even within our expansion, the local excess charge in the fluid can be comparable to the net charge on the walls. We critically discuss the onset of such local electroneutrality breakdown in particular with respect to the correction that it induces on the effective free energy profile experienced by tracer ions.


title: Ever: Mitigating Hallucination in Large Language Models through Real-Time Verification and Rectification

abstract: Large Language Models (LLMs) have demonstrated remarkable proficiency in generating fluent text. However, they often encounter the challenge of generating inaccurate or hallucinated content. This issue is common in both non-retrieval-based generation and retrieval-augmented generation approaches, and existing post-hoc rectification methods may not address the accumulated hallucination errors that may be caused by the "snowballing" issue, especially in reasoning tasks. To tackle these challenges, we introduce a novel approach called Real-time Verification and Rectification (Ever). Instead of waiting until the end of the generation process to rectify hallucinations, Ever employs a real-time, step-wise generation and hallucination rectification strategy. The primary objective is to detect and rectify hallucinations as they occur during the text generation process. When compared to both retrieval-based and non-retrieval-based baselines, Ever demonstrates a significant improvement in generating trustworthy and factually accurate text across a diverse range of tasks, including short-form QA, biography generation, and multi-hop reasoning.


title: HEALNet -- Hybrid Multi-Modal Fusion for Heterogeneous Biomedical Data

abstract: Technological advances in medical data collection such as high-resolution histopathology and high-throughput genomic sequencing have contributed to the rising requirement for multi-modal biomedical modelling, specifically for image, tabular, and graph data. Most multi-modal deep learning approaches use modality-specific architectures that are trained separately and cannot capture the crucial cross-modal information that motivates the integration of different data sources. This paper presents the Hybrid Early-fusion Attention Learning Network (HEALNet): a flexible multi-modal fusion architecture, which a) preserves modality-specific structural information, b) captures the cross-modal interactions and structural information in a shared latent space, c) can effectively handle missing modalities during training and inference, and d) enables intuitive model inspection by learning on the raw data input instead of opaque embeddings. We conduct multi-modal survival analysis on Whole Slide Images and Multi-omic data on four cancer cohorts of The Cancer Genome Atlas (TCGA). HEALNet achieves state-of-the-art performance, substantially improving over both uni-modal and recent multi-modal baselines, whilst being robust in scenarios with missing modalities.


title: Hints of Neutrino Dark Matter scattering in the CMB? Constraints from the Marginalized and Profile Distributions

abstract: We study scatter-like interactions between neutrinos and dark matter in light of different combinations of temperature, polarization and lensing data released by three independent CMB experiments - the Planck satellite, the Atacama Cosmology Telescope (ACT), and the South Pole Telescope (SPT) - in conjunction with Baryon Acoustic Oscillation (BAO) measurements. We apply two different statistical methodologies. Alongside the usual marginalization technique, we cross-check all the results through a Profile Likelihood analysis. As a first step, working under the assumption of massless neutrinos, we perform a comprehensive (re-)analysis aimed at assessing the validity of some recent results hinting at a mild preference for non-vanishing interactions from small-scale CMB data. We find compelling resilience in the results already documented in the literature, confirming that interactions with a strength $u_{\nu\rm{DM}} \sim 10^{-5} - 10^{-4}$ appear to be globally favored by ACT (both alone and in combination with Planck). This result is corroborated by the inclusion of additional data, such as the recent ACT-DR6 lensing likelihood, as well as by the Profile Likelihood analysis. Interestingly, a fully consistent preference for interactions emerges from SPT, as well, although it is weaker than the one obtained from ACT. As a second step, we repeat the same analysis considering neutrinos as massive particles. Despite the larger parameter space, all the hints pointing towards interactions are confirmed also in this more realistic case. In addition, we report a very mild preference for interactions in Planck+BAO alone (not found in the massless case) which aligns with small-scale data. While this latter result is not fully confirmed by the Profile Likelihood analysis, the profile distribution does confirm that interactions are not disfavoured by Planck.


title: R-Spin: Efficient Speaker and Noise-invariant Representation Learning with Acoustic Pieces

abstract: This paper introduces Robust Spin (R-Spin), a data-efficient domain-specific self-supervision method for speaker and noise-invariant speech representations by learning discrete acoustic units with speaker-invariant clustering (Spin). R-Spin resolves Spin's issues and enhances content representations by learning to predict acoustic pieces. R-Spin offers a 12X reduction in computational resources compared to previous state-of-the-art methods while outperforming them in severely distorted speech scenarios. This paper provides detailed analyses to show how discrete units contribute to speech encoder training and improving robustness in diverse acoustic environments.


title: WildlifeDatasets: An open-source toolkit for animal re-identification

abstract: In this paper, we present WildlifeDatasets (https://github.com/WildlifeDatasets/wildlife-datasets) - an open-source toolkit intended primarily for ecologists and computer-vision / machine-learning researchers. The WildlifeDatasets is written in Python, allows straightforward access to publicly available wildlife datasets, and provides a wide variety of methods for dataset pre-processing, performance analysis, and model fine-tuning. We showcase the toolkit in various scenarios and baseline experiments, including, to the best of our knowledge, the most comprehensive experimental comparison of datasets and methods for wildlife re-identification, including both local descriptors and deep learning approaches. Furthermore, we provide the first-ever foundation model for individual re-identification within a wide range of species - MegaDescriptor - that provides state-of-the-art performance on animal re-identification datasets and outperforms other pre-trained models such as CLIP and DINOv2 by a significant margin. To make the model available to the general public and to allow easy integration with any existing wildlife monitoring applications, we provide multiple MegaDescriptor flavors (i.e., Small, Medium, and Large) through the HuggingFace hub (https://huggingface.co/BVRA).


title: A high-order local discontinuous Galerkin method for the $p$-Laplace equation

abstract: We study the high-order local discontinuous Galerkin (LDG) method for the $p$-Laplace equation. We reformulate our spatial discretization as an equivalent convex minimization problem and use a preconditioned gradient descent method as the nonlinear solver. For the first time, a weighted preconditioner that provides $hk$-independent convergence is applied in the LDG setting. For polynomial order $k \geqslant 1$, we rigorously establish the solvability of our scheme and provide a priori error estimates in a mesh-dependent energy norm. Our error estimates are under a different and non-equivalent distance from existing LDG results. For arbitrarily high-order polynomials under the assumption that the exact solution has enough regularity, the error estimates demonstrate the potential for high-order accuracy. Our numerical results exhibit the desired convergence speed facilitated by the preconditioner, and we observe best convergence rates in gradient variables in alignment with linear LDG, and optimal rates in the primal variable when $1 < p \leqslant 2$.


title: The least eigenvalues of integral circulant graphs

abstract: The integral circulant graph $ICG_n (D)$ has the vertex set $Z_n = \{0, 1, 2, \ldots, n - 1\}$, where vertices $a$ and $b$ are adjacent if $\gcd(a-b,n)\in D$, with $D \subseteq \{d : d \mid n,\ 1\leq d<n\}$. In this paper, we establish that the minimal value of the least eigenvalues (minimal least eigenvalue) of integral circulant graphs $ICG_n(D)$, given an order $n$ with its prime factorization $p_1^{\alpha_1}\cdots p_k^{\alpha_k}$, is equal to $-\frac{n}{p_1}$. Moreover, we show that the minimal least eigenvalue of connected integral circulant graphs $ICG_n(D)$ of order $n$ whose complements are also connected is equal to $-\frac{n}{p_1}+p_1^{\alpha_1-1}$. Finally, we determine the second minimal eigenvalue among all least eigenvalues within the class of connected integral circulant graphs of a prescribed order $n$ and show it to be equal to $-\frac{n}{p_1}+p_1-1$ or $-\frac{n}{p_1}+1$, depending on whether $\alpha_1>1$ or not, respectively. In all the aforementioned tasks, we provide a complete characterization of graphs whose spectra contain these determined minimal least eigenvalues.


title: Rheology of dense suspensions of ideally conductive particles in an electric field

abstract: The rheological behaviour of dense suspensions of ideally conductive particles in the presence of both electric field and shear flow is studied using large-scale numerical simulations. Under the action of an electric field, these particles are known to undergo dipolophoresis, which is the combination of two nonlinear electrokinetic phenomena -- induced-charge electrophoresis and dielectrophoresis. For ideally conductive particles, induced-charge electrophoresis is predominant over dielectrophoresis, resulting in transient pairing dynamics. The shear viscosity and first and second normal stress differences $N_1$ and $N_2$ of such suspensions are examined over a range of volume fractions $15\% \leqslant \phi \leqslant 50\%$ as a function of Mason number $Mn$, which measures the relative importance of viscous shear stress over electrokinetic-driven stress. For $Mn < 1$ or low shear rates, the dipolophoresis is shown to dominate the dynamics, resulting in a relatively low-viscosity state. The positive $N_1$ and negative $N_2$ are observed at $\phi < 30\%$, which is similar to Brownian suspensions, while their signs are reversed at $\phi \ge 30\%$. For $Mn \ge 1$, the shear thickening starts to arise at $\phi \ge 30\%$, and an almost five-fold increase in viscosity occurs at $\phi = 50\%$. Both $N_1$ and $N_2$ are negative for $Mn \gg 1$ at all volume fractions considered. We illuminate the transition in rheological behaviours from dipolophoresis to shear dominance around $Mn = 1$ in connection to suspension microstructure and dynamics. Lastly, our findings reveal the potential use of nonlinear electrokinetics as a means of active rheology control for such suspensions.


title: Universal NER: A Gold-Standard Multilingual Named Entity Recognition Benchmark

abstract: We introduce Universal NER (UNER), an open, community-driven project to develop gold-standard NER benchmarks in many languages. The overarching goal of UNER is to provide high-quality, cross-lingually consistent annotations to facilitate and standardize multilingual NER research. UNER v1 contains 18 datasets annotated with named entities in a cross-lingual consistent schema across 12 diverse languages. In this paper, we detail the dataset creation and composition of UNER; we also provide initial modeling baselines on both in-language and cross-lingual learning settings. We release the data, code, and fitted models to the public.


title: Convergence analysis of a primal-dual optimization-by-continuation algorithm

abstract: We present a numerical iterative optimization algorithm for the minimization of a cost function consisting of a linear combination of three convex terms, one of which is differentiable, a second one is prox-simple and the third one is the composition of a linear map and a prox-simple function. The algorithm's special feature lies in its ability to approximate, in a single iteration run, the minimizers of the cost function for many different values of the parameters determining the relative weight of the three terms in the cost function. A proof of convergence of the algorithm, based on an inexact variable metric approach, is also provided. As a special case, one recovers a generalization of the primal-dual algorithm of Chambolle and Pock, and also of the proximal-gradient algorithm. Finally, we show how it is related to a primal-dual iterative algorithm based on inexact proximal evaluations of the non-smooth terms of the cost function.


title: Frustrated magnets in the limit of infinite dimensions: dynamics and disorder-free glass transition

abstract: We study the statistical mechanics and the equilibrium dynamics of a system of classical Heisenberg spins with frustrated interactions on a $d$-dimensional simple hypercubic lattice, in the limit of infinite dimensionality $d \to \infty$. In the analysis we consider a class of models in which the matrix of exchange constants is a linear combination of powers of the adjacency matrix. This choice leads to a special property: the Fourier transform of the exchange coupling $J(\mathbf{k})$ presents a $(d-1)$-dimensional surface of degenerate maxima in momentum space. Using the cavity method, we find that the statistical mechanics of the system presents for $d \to \infty$ a paramagnetic solution which remains locally stable at all temperatures down to $T = 0$. To investigate whether the system undergoes a glass transition we study its dynamical properties assuming a purely dissipative Langevin equation, and mapping the system to an effective single-spin problem subject to a colored Gaussian noise. The conditions under which a glass transition occurs are discussed including the possibility of a local anisotropy and a simple type of anisotropic exchange. The general results are applied explicitly to a simple model, equivalent to the isotropic Heisenberg antiferromagnet on the $d$-dimensional fcc lattice with first and second nearest-neighbour interactions tuned to the point $J_{1} = 2J_{2}$. In this model, we find a dynamical glass transition at a temperature $T_{\rm g}$ separating a high-temperature liquid phase and a low temperature vitrified phase. At the dynamical transition, the Edwards-Anderson order parameter presents a jump demonstrating a first-order phase transition.


title: Fluid/p-form duality

abstract: In this study, we demonstrate that an inviscid fluid in a near-equilibrium state, when viewed in the Lagrangian picture in d+1 spacetime dimensions, can be reformulated as a (d-1)-form gauge theory. We construct a fluid/p-form dictionary and show that volume-preserving diffeomorphisms on the fluid side manifest as a U(1) gauge symmetry on the {(p+1)-form} gauge theory side. {Intriguingly, Kelvin's circulation theorem and the mass continuity equation respectively appear as the Gauss law and the Bianchi identity on the gauge theory side.} Furthermore, we show that at the level of the sources, the vortices in the fluid side correspond to the p-branes in the gauge theory side. We also consider fluid mechanics in the presence of boundaries and examine the boundary symmetries and corresponding charges from both the fluid and gauge theory perspectives.


title: Transient nucleation driven by solvent evaporation

abstract: We theoretically investigate homogeneous crystal nucleation in a solution containing a solute and a volatile solvent. The solvent evaporates from the solution, thereby continuously increasing the concentration of the solute. We view it as an idealized model for the far-out-of-equilibrium conditions present during the liquid-state manufacturing of organic electronic devices. Our model is based on classical nucleation theory, taking the solvent to be a source of the transient conditions in which the solute drops out of solution. Other than that, the solvent is not directly involved in the nucleation process itself. We approximately solve the kinetic master equations using a combination of Laplace transforms and singular perturbation theory, providing an analytical expression for the nucleation flux, predicting that (i) the nucleation flux lags slightly behind a commonly used quasi-steady-state approximation, an effect that is governed by two counteracting effects originating from the solvent evaporation: while a faster evaporation rate results in an increasingly larger influence of the lag time on the nucleation flux, this lag time itself we find to decrease with increasing evaporation rate, (ii) the nucleation flux and the quasi-steady-state nucleation flux are never identical, except trivially in the stationary limit and (iii) the initial induction period of the nucleation flux, which we characterize with a generalized induction time, decreases weakly with the evaporation rate. This indicates that the relevant time scale for nucleation also decreases with increasing evaporation rate. Our analytical theory compares favorably with results from numerical evaluation of the governing kinetic equations.


title: Jailbreaking GPT-4V via Self-Adversarial Attacks with System Prompts

abstract: Existing work on jailbreak Multimodal Large Language Models (MLLMs) has focused primarily on adversarial examples in model inputs, with less attention to vulnerabilities, especially in model API. To fill the research gap, we carry out the following work: 1) We discover a system prompt leakage vulnerability in GPT-4V. Through carefully designed dialogue, we successfully extract the internal system prompts of GPT-4V. This finding indicates potential exploitable security risks in MLLMs; 2) Based on the acquired system prompts, we propose a novel MLLM jailbreaking attack method termed SASP (Self-Adversarial Attack via System Prompt). By employing GPT-4 as a red teaming tool against itself, we aim to search for potential jailbreak prompts leveraging stolen system prompts. Furthermore, in pursuit of better performance, we also add human modification based on GPT-4's analysis, which further improves the attack success rate to 98.7\%; 3) We evaluated the effect of modifying system prompts to defend against jailbreaking attacks. Results show that appropriately designed system prompts can significantly reduce jailbreak success rates. Overall, our work provides new insights into enhancing MLLM security, demonstrating the important role of system prompts in jailbreaking. This finding could be leveraged to greatly facilitate jailbreak success rates while also holding the potential for defending against jailbreaks.


title: Fast Detection of Phase Transitions with Multi-Task Learning-by-Confusion

abstract: Machine learning has been successfully used to study phase transitions. One of the most popular approaches to identifying critical points from data without prior knowledge of the underlying phases is the learning-by-confusion scheme. As input, it requires system samples drawn from a grid of the parameter whose change is associated with potential phase transitions. Up to now, the scheme required training a distinct binary classifier for each possible splitting of the grid into two sides, resulting in a computational cost that scales linearly with the number of grid points. In this work, we propose and showcase an alternative implementation that only requires the training of a single multi-class classifier. Ideally, such multi-task learning eliminates the scaling with respect to the number of grid points. In applications to the Ising model and an image dataset generated with Stable Diffusion, we find significant speedups that closely correspond to the ideal case, with only minor deviations.


title: A short note on effective Pauli noise models

abstract: We provide a simple prescription to extract an effective Pauli noise model from classical simulations of a noisy experimental protocol for a unitary gate. This prescription yields the closest Pauli channel approximation to the error channel associated with the gate implementation, as measured by the Frobenius distance between quantum channels. Informed by these results, we highlight some puzzles regarding the quantitative treatment of coherent errors.


title: Social Meme-ing: Measuring Linguistic Variation in Memes

abstract: Much work in the space of NLP has used computational methods to explore sociolinguistic variation in text. In this paper, we argue that memes, as multimodal forms of language comprised of visual templates and text, also exhibit meaningful social variation. We construct a computational pipeline to cluster individual instances of memes into templates and semantic variables, taking advantage of their multimodal structure in doing so. We apply this method to a large collection of meme images from Reddit and make available the resulting \textsc{SemanticMemes} dataset of 3.8M images clustered by their semantic function. We use these clusters to analyze linguistic variation in memes, discovering not only that socially meaningful variation in meme usage exists between subreddits, but that patterns of meme innovation and acculturation within these communities align with previous findings on written language.


title: Practical Use of ChatGPT in Psychiatry for Treatment Plan and Psychoeducation

abstract: Artificial Intelligence (AI) has revolutionized various fields, including medicine and mental health support. One promising application is ChatGPT, an advanced conversational AI model that uses deep learning techniques to provide human-like responses. This review paper explores the potential impact of ChatGPT in psychiatry and its various applications, highlighting its role in therapy and counseling techniques, self-help and coping strategies, mindfulness and relaxation techniques, screening and monitoring, education and information dissemination, specialized support, group and family support, learning and training, expressive and artistic therapies, telepsychiatry and online support, and crisis management and prevention. While ChatGPT offers personalized, accessible, and scalable support, it is essential to emphasize that it should not replace the expertise and guidance of qualified mental health professionals. Ethical considerations, such as user privacy, data security, and human oversight, are also discussed. By examining the potential and challenges, this paper sheds light on the responsible integration of ChatGPT in psychiatric research and practice, fostering improved mental health outcomes.