title: Compact and De-biased Negative Instance Embedding for Multi-Instance Learning on Whole-Slide Image Classification

abstract: Whole-slide image (WSI) classification is a challenging task because 1) patches from WSI lack annotation, and 2) WSI possesses unnecessary variability, e.g., stain protocol. Recently, Multiple-Instance Learning (MIL) has made significant progress, allowing for classification based on slide-level, rather than patch-level, annotations. However, existing MIL methods ignore that all patches from normal slides are normal. Using this free annotation, we introduce a semi-supervision signal to de-bias the inter-slide variability and to capture the common factors of variation within normal patches. Because our method is orthogonal to the MIL algorithm, we evaluate our method on top of the recently proposed MIL algorithms and also compare the performance with other semi-supervised approaches. We evaluate our method on two public WSI datasets including Camelyon-16 and TCGA lung cancer and demonstrate that our approach significantly improves the predictive performance of existing MIL algorithms and outperforms other semi-supervised algorithms. We release our code at https://github.com/AITRICS/pathology_mil.


title: Fast Data-driven Greedy Sensor Selection for Ridge Regression

abstract: We propose a data-driven sensor-selection algorithm for accurate estimation of the target variables from the selected measurements. The target variables are assumed to be estimated by a ridge-regression estimator which is trained based on the data. The proposed algorithm greedily selects sensors for minimization of the cost function of the estimator. Sensor selection which prevents the overfitting of the resulting estimator can be realized by setting a positive regularization parameter. The greedy solution is computed in quite a short time by using some recurrent relations that we derive. Furthermore, we show that sensor selection can be accelerated by dimensionality reduction of the target variables without large deterioration of the estimation performance. The effectiveness of the proposed algorithm is verified for two real-world datasets. The first dataset is a dataset of sea surface temperature for sensor selection for reconstructing large data, and the second is a dataset of surface pressure distribution and yaw angle of a ground vehicle for sensor selection for estimation. The experiments reveal that the proposed algorithm outperforms some data-drive selection algorithms including the orthogonal matching pursuit.


title: Efficiency at Scale: Investigating the Performance of Diminutive Language Models in Clinical Tasks

abstract: The entry of large language models (LLMs) into research and commercial spaces has led to a trend of ever-larger models, with initial promises of generalisability, followed by a widespread desire to downsize and create specialised models without the need for complete fine-tuning, using Parameter Efficient Fine-tuning (PEFT) methods. We present an investigation into the suitability of different PEFT methods to clinical decision-making tasks, across a range of model sizes, including extremely small models with as few as $25$ million parameters. Our analysis shows that the performance of most PEFT approaches varies significantly from one task to another, with the exception of LoRA, which maintains relatively high performance across all model sizes and tasks, typically approaching or matching full fine-tuned performance. The effectiveness of PEFT methods in the clinical domain is evident, particularly for specialised models which can operate on low-cost, in-house computing infrastructure. The advantages of these models, in terms of speed and reduced training costs, dramatically outweighs any performance gain from large foundation LLMs. Furthermore, we highlight how domain-specific pre-training interacts with PEFT methods and model size, and discuss how these factors interplay to provide the best efficiency-performance trade-off. Full code available at: tbd.


title: Quantum second harmonic generation in terms of elementary processes

abstract: We address the quantum dynamics of second harmonic generation with a perturbative approach. By inspecting the Taylor expansion of the unitary evolution, we identify the subsequent application of annihilation and creation operators as elementary processes and find out how the expansion of the second-harmonic photon-number probability distribution can be expressed in terms of the interplay of these processes. We show that overlaps between the output states of different elementary processes contribute to the expansion of the probability distribution and provide a diagrammatic technique to analytically retrieve terms of the distribution expansion at any order.


title: Theory of magnetic properties in QED environments: application to molecular aromaticity

abstract: In this work, we present ab initio cavity QED methods which include interactions with a static magnetic field and nuclear spin degrees of freedom using different treatments of the quantum electromagnetic field. We derive explicit expressions for QED-HF magnetizability, nuclear shielding, and spin-spin coupling tensors. We apply this theory to explore the influence of the cavity field on the magnetizability of saturated, unsaturated, and aromatic hydrocarbons, showing the effects of different polarization orientations and coupling strengths. We also examine how the cavity affects aromaticity descriptors, such as the nucleus-independent chemical shift and magnetizability exaltation. We employ these descriptors to study the trimerization reaction of acetylene to benzene. We show how the optical cavity induces modifications in the aromatic character of the transition state leading to variations in the activation energy of the reaction. Our findings shed light on the effects induced by the cavity on magnetic properties, especially in the context of aromatic molecules, providing valuable insights into understanding the interplay between the quantum electromagnetic field and molecules.


title: Envisioning the Future Role of 3D Wireless Networks in Preventing and Managing Disasters and Emergency Situations

abstract: In an era marked by unprecedented climatic upheavals and evolving urban landscapes, the role of advanced communication networks in disaster prevention and management is becoming increasingly critical. This paper explores the transformative potential of 3D wireless networks, an innovative amalgamation of terrestrial, aerial, and satellite technologies, in enhancing disaster response mechanisms. We delve into a myriad of use cases, ranging from large facility evacuations to wildfire management, underscoring the versatility of these networks in ensuring timely communication, real-time situational awareness, and efficient resource allocation during crises. We also present an overview of cutting-edge prototypes, highlighting the practical feasibility and operational efficacy of 3D wireless networks in real-world scenarios. Simultaneously, we acknowledge the challenges posed by aspects such as cybersecurity, cross-border coordination, and physical layer technological hurdles, and propose future directions for research and development in this domain.


title: Jailbreaking Proprietary Large Language Models using Word Substitution Cipher

abstract: Large Language Models (LLMs) are aligned to moral and ethical guidelines but remain susceptible to creative prompts called Jailbreak that can bypass the alignment process. However, most jailbreaking prompts contain harmful questions in the natural language (mainly English), which can be detected by the LLM themselves. In this paper, we present jailbreaking prompts encoded using cryptographic techniques. We first present a pilot study on the state-of-the-art LLM, GPT-4, in decoding several safe sentences that have been encrypted using various cryptographic techniques and find that a straightforward word substitution cipher can be decoded most effectively. Motivated by this result, we use this encoding technique for writing jailbreaking prompts. We present a mapping of unsafe words with safe words and ask the unsafe question using these mapped words. Experimental results show an attack success rate (up to 59.42%) of our proposed jailbreaking approach on state-of-the-art proprietary models including ChatGPT, GPT-4, and Gemini-Pro. Additionally, we discuss the over-defensiveness of these models. We believe that our work will encourage further research in making these LLMs more robust while maintaining their decoding capabilities.


title: Are ID Embeddings Necessary? Whitening Pre-trained Text Embeddings for Effective Sequential Recommendation

abstract: Recent sequential recommendation models have combined pre-trained text embeddings of items with item ID embeddings to achieve superior recommendation performance. Despite their effectiveness, the expressive power of text features in these models remains largely unexplored. While most existing models emphasize the importance of ID embeddings in recommendations, our study takes a step further by studying sequential recommendation models that only rely on text features and do not necessitate ID embeddings. Upon examining pretrained text embeddings experimentally, we discover that they reside in an anisotropic semantic space, with an average cosine similarity of over 0.8 between items. We also demonstrate that this anisotropic nature hinders recommendation models from effectively differentiating between item representations and leads to degenerated performance. To address this issue, we propose to employ a pre-processing step known as whitening transformation, which transforms the anisotropic text feature distribution into an isotropic Gaussian distribution. Our experiments show that whitening pre-trained text embeddings in the sequential model can significantly improve recommendation performance. However, the full whitening operation might break the potential manifold of items with similar text semantics. To preserve the original semantics while benefiting from the isotropy of the whitened text features, we introduce WhitenRec+, an ensemble approach that leverages both fully whitened and relaxed whitened item representations for effective recommendations. We further discuss and analyze the benefits of our design through experiments and proofs. Experimental results on three public benchmark datasets demonstrate that WhitenRec+ outperforms state-of-the-art methods for sequential recommendation.


title: Automatic Circular Take-off and Landing of Tethered Motorized Aircraft

abstract: We consider a motorized aircraft tethered to a central anchorage point in a configuration similar to a control line model airplane. For this system, we address the problem of automatic take-off and landing (ATOL) with a circular path, whose center and radius are defined by the anchorage point and the tether length, respectively. We propose a hierarchical control architecture for ATOL and discuss the controllers designed for each control layer and for each of the flight phases. Simulation results are reported, showing the viability of the approach, but also showing the limitations on the maximum altitude attainable with a fixed-tether length. The tethered aircraft and the proposed ATOL control architecture are to be used in an Airborne Wind Energy System.


title: Explicit formula and quasicrystal definition

abstract: We show that the Riemann hypothesis is true if and only if the measure $$\mu=-\sum_{n=1}^\infty\frac{\Lambda(n)}{\sqrt{n}}(\delta_{\log n}+\delta_{-\log n})+2\cosh(x/2)\,dx$$ is a tempered distribution. In this case it is the Fourier transform of another measure $$\mathcal{F}\Bigl(\sum_{\gamma}\delta_{\gamma/2\pi}-2\vartheta'(2\pi t)\,dt\Bigr)=\mu.$$ We propose a definition of Fourier quasi-crystal to make sense of Dyson suggestion.


title: Studying the Impact of Quantum-Specific Hyperparameters on Hybrid Quantum-Classical Neural Networks

abstract: In current noisy intermediate-scale quantum devices, hybrid quantum-classical neural networks (HQNNs) represent a promising solution that combines the strengths of classical machine learning with quantum computing capabilities. Compared to classical deep neural networks (DNNs), HQNNs present an additional set of hyperparameters, which are specific to quantum circuits. These quantum-specific hyperparameters, such as quantum circuit depth, number of qubits, type of entanglement, number of shots, and measurement observables, can significantly impact the behavior of the HQNNs and their capabilities to learn the given task. In this paper, we investigate the impact of these variations on different HQNN models for image classification tasks, implemented on the PennyLane framework. We aim to uncover intuitive and counter-intuitive learning patterns of HQNN models within granular levels of controlled quantum perturbations, to form a sound basis for their correlation to accuracy and training time. The outcome of our study opens new avenues for designing efficient HQNN algorithms and builds a foundational base for comprehending and identifying tunable hyperparameters of HQNN models that can lead to useful design implementation and usage.


title: On the spectrum of $2\times 2$ Dirac operator with degenerate boundary conditions

abstract: We study the spectral problem for the Dirac operator with degenerate boundary conditions and a complex-valued summable potential. Sufficient conditions are found under which the spectrum of the problem under consideration coincides with the spectrum of the corresponding unperturbed operator.


title: Combination of searches for heavy spin-1 resonances using 139 fb$^{-1}$ of proton-proton collision data at $\sqrt{s} = 13$ TeV with the ATLAS detector

abstract: A combination of searches for new heavy spin-1 resonances decaying into different pairings of $W$, $Z$, or Higgs bosons, as well as directly into leptons or quarks, is presented. The data sample used corresponds to 139 fb$^{-1}$ of proton-proton collisions at $\sqrt{s}$ = 13 TeV collected during 2015-2018 with the ATLAS detector at the CERN Large Hadron Collider. Analyses selecting quark pairs ($qq$, $bb$, $t\bar{t}$, and $tb$) or third-generation leptons ($\tau\nu$ and $\tau\tau$) are included in this kind of combination for the first time. A simplified model predicting a spin-1 heavy vector-boson triplet is used. Cross-section limits are set at the 95% confidence level and are compared with predictions for the benchmark model. These limits are also expressed in terms of constraints on couplings of the heavy vector-boson triplet to quarks, leptons, and the Higgs boson. The complementarity of the various analyses increases the sensitivity to new physics, and the resulting constraints are stronger than those from any individual analysis considered. The data exclude a heavy vector-boson triplet with mass below 5.8 TeV in a weakly coupled scenario, below 4.4 TeV in a strongly coupled scenario, and up to 1.5 TeV in the case of production via vector-boson fusion.


title: A maximum likelihood estimation of L\'evy-driven stochastic systems for univariate and multivariate time series of observations

abstract: Literature is full of inference techniques developed to estimate the parameters of stochastic dynamical systems driven by the well-known Brownian noise. Such diffusion models are often inappropriate models to properly describe the dynamics reflected in many real-world data which are dominated by jump discontinuities of various sizes and frequencies. To account for the presence of jumps, jump-diffusion models are introduced and some inference techniques are developed. Jump-diffusion models are also inadequate models since they fail to reflect the frequent occurrence as well as the continuous spectrum of natural jumps. It is, therefore, crucial to depart from the classical stochastic systems like diffusion and jump-diffusion models and resort to stochastic systems where the regime of stochasticity is governed by the stochastic fluctuations of L\'evy type. Reconstruction of L\'evy-driven dynamical systems, however, has been a major challenge. The literature on the reconstruction of L\'evy-driven systems is rather poor: there are few reconstruction algorithms developed which suffer from one or several problems such as being data-hungry, failing to provide a full reconstruction of noise parameters, tackling only some specific systems, failing to cope with multivariate data in practice, lacking proper validation mechanisms, and many more. This letter introduces a maximum likelihood estimation procedure which grants a full reconstruction of the system, requires less data, and its implementation for multivariate data is quite straightforward. To the best of our knowledge this contribution is the first to tackle all the mentioned shortcomings. We apply our algorithm to simulated data as well as an ice-core dataset spanning the last glaciation. In particular, we find new insights about the dynamics of the climate in the curse of the last glaciation which was not found in previous studies.


title: U$^2$MRPD: Unsupervised undersampled MRI reconstruction by prompting a large latent diffusion model

abstract: Implicit visual knowledge in a large latent diffusion model (LLDM) pre-trained on natural images is rich and hypothetically universal to natural and medical images. To test this hypothesis, we introduce a novel framework for Unsupervised Undersampled MRI Reconstruction by Prompting a pre-trained large latent Diffusion model ( U$^2$MRPD). Existing data-driven, supervised undersampled MRI reconstruction networks are typically of limited generalizability and adaptability toward diverse data acquisition scenarios; yet U$^2$MRPD supports image-specific MRI reconstruction by prompting an LLDM with an MRSampler tailored for complex-valued MRI images. With any single-source or diverse-source MRI dataset, U$^2$MRPD's performance is further boosted by an MRAdapter while keeping the generative image priors intact. Experiments on multiple datasets show that U$^2$MRPD achieves comparable or better performance than supervised and MRI diffusion methods on in-domain datasets while demonstrating the best generalizability on out-of-domain datasets. To the best of our knowledge, U$^2$MRPD is the {\bf first} unsupervised method that demonstrates the universal prowess of a LLDM, %trained on magnitude-only natural images in medical imaging, attaining the best adaptability for both MRI database-free and database-available scenarios and generalizability towards out-of-domain data.


title: Spanning Matrices via Satisfiability Solving

abstract: We propose a new encoding of the first-order connection method as a Boolean satisfiability problem. The encoding eschews tree-like presentations of the connection method in favour of matrices, as we show that tree-like calculi have a number of drawbacks in the context of satisfiability solving. The matrix setting permits numerous global refinements of the basic connection calculus. We also show that a suitably-refined calculus is a decision procedure for the Bernays-Sch\"onfinkel class.


title: Spectral variations within solar flare ribbons

abstract: Solar flare ribbons are intense brightenings of principally chromospheric material that are responsible for a large fraction of the chromospheric emission in solar and stellar flares. We present an on-disc observation of flare ribbon substructures in an X9.3-class flare observed by the Swedish 1-m Solar Telescope. We identify categories of ribbon substructures seen in the Ca II 8542 \AA, H$\alpha$, and Ca II K lines, focusing on their spatial locations and their (spectro-)polarimetric properties. Color Collapsed Plotting (COCOPLOT) software is used to assist in identifying areas of interest. We present five categories of spectral profiles within the general body of the flare ribbon: (1) Extremely broadened spectral line profiles, where the standard Fabry-Perot interferometer wavelength windows ($\approx 70$ km s$^{-1}$) are insufficiently wide to allow for a complete analysis of the dynamics and atmospheric conditions. The mechanisms causing this degree of this broadening are not yet clearly understood. (2) Long-lived, dense kernels that manifest as more saturated chromospheric line profiles with lower signal in both Stokes parameters. They are interpreted as footpoints of bunched magnetic field loops, whose chromospheric lines form at greater heights than the nearby areas. (3) Doppler-shifted leading edges of the flare ribbon in regions that transiently display lower Stokes signals due to the emission dominating at greater heights in the atmosphere. (4) Condensed coronal rain overlapping the flare ribbons in the line of sight, producing exceptionally high Doppler shifts near the footpoints...


title: Retrieve Only When It Needs: Adaptive Retrieval Augmentation for Hallucination Mitigation in Large Language Models

abstract: Hallucinations pose a significant challenge for the practical implementation of large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal hallucinations. While incorporating external information can help fill knowledge gaps, it also introduces the risk of irrelevant information, thereby increasing the likelihood of external hallucinations. A careful and balanced integration of the parametric knowledge within LLMs with external information is crucial to alleviate hallucinations. In this study, we present Rowen, a novel approach that enhances LLMs with a selective retrieval augmentation process tailored to address hallucinated outputs. This process is governed by a multilingual semantic-aware detection module, which evaluates the consistency of the perturbed responses across various languages for the same queries. Upon detecting inconsistencies indicative of hallucinations, Rowen activates the retrieval of external information to rectify the model outputs. Rowen adeptly harmonizes the intrinsic parameters in LLMs with external knowledge sources, effectively mitigating hallucinations by ensuring a balanced integration of internal reasoning and external evidence. Through a comprehensive empirical analysis, we demonstrate that Rowen surpasses the current state-of-the-art in both detecting and mitigating hallucinated content within the outputs of LLMs.


title: Advancements and challenges in plasmon-exciton quantum emitters based on colloidal quantum dots

abstract: The Nobel Prizes in Physics (2022) and Chemistry (2023) heralded the recognition of quantum information science and the synthesis of quantum dots, respectively. This acknowledgment has propelled colloidal quantum dots and perovskite nanocrystals to the forefront of quantum technologies. Their distinct emission properties, facilitating the efficient generation of both single photons and photon pairs, render them particularly captivating. Moreover, their adaptability to diverse structures, ranging from traditional electronics to nanopatterned frameworks, underscores their pivotal role in shaping quantum technologies. Despite notable strides in synthesis, certain properties require refinement for enhanced applicability in quantum information, encompassing emission brightness, stability, single photon indistinguishability, and entanglement fidelity of photon pairs. Here we offer an overview of recent achievements in plasmon-exciton quantum emitters based on luminescent semiconductor nanocrystals. Emphasizing the utilization of the light-matter coupling phenomenon, we explore how this interaction enables the manipulation of quantum properties without altering the chemical structure of the emitters. This approach addresses critical aspects for quantum information applications, offering precise control over emission rate, intensity, and energy. The development of these hybrid systems represents a significant stride forward, demonstrating their potential to overcome existing challenges and advance the integration of quantum emitters into cutting-edge quantum technology applications.


title: Can LLMs Speak For Diverse People? Tuning LLMs via Debate to Generate Controllable Controversial Statements

abstract: Making LLMs speak for different, especially minority groups of people, and generate statements supporting their diverse or even controversial perspectives is critical to creating an inclusive environment. However, existing LLMs lack sufficient controllability to the stance of their generated content, which often contains inconsistent, neutral, or biased statements. In this paper, we improve the controllability of LLMs in generating statements supporting an argument the user defined in the prompt. We find that multi-round debates between two LLMs with opposite stances generate higher-quality and more salient statements for each, which are important training data to improve the controllability of LLMs. Motivated by this, we develop a novel debate & tuning (DEBATUNE) pipeline finetuning LLMs to generate the statements obtained via debate. To examine DEBATUNE, we curate the largest dataset of debate topics so far, which covers 710 controversial topics and corresponding arguments for each topic. Evaluations by the GPT-4 judge with a novel controversy controllability metric show that LLMs' capability of generating diverse perspectives is significantly improved by DEBATUNE. Moreover, such controllability can be generalized to unseen topics, generating high-quality statements supporting controversial arguments.


title: A mortar method for the coupled Stokes-Darcy problem using the MAC scheme for Stokes and mixed finite elements for Darcy

abstract: A discretization method with non-matching grids is proposed for the coupled Stokes-Darcy problem that uses a mortar variable at the interface to couple the marker and cell (MAC) method in the Stokes domain with the Raviart-Thomas mixed finite element pair in the Darcy domain. Due to this choice, the method conserves linear momentum and mass locally in the Stokes domain and exhibits local mass conservation in the Darcy domain. The MAC scheme is reformulated as a mixed finite element method on a staggered grid, which allows for the proposed scheme to be analyzed as a mortar mixed finite element method. We show that the discrete system is well-posed and derive a priori error estimates that indicate first order convergence in all variables. The system can be reduced to an interface problem concerning only the mortar variables, leading to a non-overlapping domain decomposition method. Numerical examples are presented to illustrate the theoretical results and the applicability of the method.


title: Credential Control Balance: A Universal Blockchain Account Model Abstract From Bank to Bitcoin, Ethereum External Owned Account and Account Abstraction

abstract: Blockchain market value peaked at $3 trillion, fell to $1 trillion, then recovered to $1.5 trillion and is rising again. Blockchain accounts secure most on-chain assets in this huge market (Web-12). This paper initiates a universal blockchain account model from a comprehensive review of blockchain account development, encompassing both academic and industry perspectives. This paper uses a model analysis method to analysis the account progress and create high level new account model. And it uses systematic literature review method to search, filter, analysis and evaluate the papers about account models and analyzes related technology trade-offs. Searching with key words: blockchain, account, private key and security in WOS, Scopus and Bitcoin and Ethereum community repositories, this research provides in-depth insights into the design and evaluation of account models, from traditional bank accounts to Bitcoin, EVM-adaptable, and abstraction accounts. Through data-driven comparisons of account models (security, cost, adoption), this study also explores future directions and provides an overview of cross-model account theory, guiding further blockchain research. This paper leaves deeper dives into model change drivers, application technology advancements.


title: Multitask Kernel-based Learning with Logic Constraints

abstract: This paper presents a general framework to integrate prior knowledge in the form of logic constraints among a set of task functions into kernel machines. The logic propositions provide a partial representation of the environment, in which the learner operates, that is exploited by the learning algorithm together with the information available in the supervised examples. In particular, we consider a multi-task learning scheme, where multiple unary predicates on the feature space are to be learned by kernel machines and a higher level abstract representation consists of logic clauses on these predicates, known to hold for any input. A general approach is presented to convert the logic clauses into a continuous implementation, that processes the outputs computed by the kernel-based predicates. The learning task is formulated as a primal optimization problem of a loss function that combines a term measuring the fitting of the supervised examples, a regularization term, and a penalty term that enforces the constraints on both supervised and unsupervised examples. The proposed semi-supervised learning framework is particularly suited for learning in high dimensionality feature spaces, where the supervised training examples tend to be sparse and generalization difficult. Unlike for standard kernel machines, the cost function to optimize is not generally guaranteed to be convex. However, the experimental results show that it is still possible to find good solutions using a two stage learning schema, in which first the supervised examples are learned until convergence and then the logic constraints are forced. Some promising experimental results on artificial multi-task learning tasks are reported, showing how the classification accuracy can be effectively improved by exploiting the a priori rules and the unsupervised examples.


title: Enhancing Role-playing Systems through Aggressive Queries: Evaluation and Improvement

abstract: The advent of Large Language Models (LLMs) has propelled dialogue generation into new realms, particularly in the field of role-playing systems (RPSs). While enhanced with ordinary role-relevant training dialogues, existing LLM-based RPSs still struggle to align with roles when handling intricate and trapped queries in boundary scenarios. In this paper, we design the Modular ORchestrated Trap-setting Interaction SystEm (MORTISE) to benchmark and improve the role-playing LLMs' performance. MORTISE can produce highly role-relevant aggressive queries through the collaborative effort of multiple LLM-based modules, and formulate corresponding responses to create an adversarial training dataset via a consistent response generator. We select 190 Chinese and English roles to construct aggressive queries to benchmark existing role-playing LLMs. Through comprehensive evaluation, we find that existing models exhibit a general deficiency in role alignment capabilities. We further select 180 of the roles to collect an adversarial training dataset (named RoleAD) and retain the other 10 roles for testing. Experiments on models improved by RoleAD indicate that our adversarial dataset ameliorates this deficiency, with the improvements demonstrating a degree of generalizability in ordinary scenarios.


title: The Very Early Soft X-ray Plateau of GRB 230307A: Signature of an Evolving Radiative Efficiency in Magnetar Wind Dissipation?

abstract: Very recently, a particularly long gamma-ray burst (GRB) 230307A was reported and proposed to originate from a compact binary merger based on its host galaxy property, kilonova, and heavy elements. More intriguingly, a very early plateau followed by a rapid decline in soft X-ray band was detected in its light curve by the Lobster Eye Imager for Astronomy, indicating strong evidence of the existence of a magnetar as the merger product. This work explores that the Magnetar Wind Internal Gradual MAgnetic Dissipation (MIGMAD) model, in which the radiative efficiency evolves over time, successfully fits it to the observed data. Our results reinforce the notion that the X-ray plateau serves as a powerful indicator of a magnetar and imply that an evolving efficiency is likely to be a common feature in X-ray plateaus of GRB afterglows. In addition, we also discuss the explanations for the prompt emission, GRB afterglows, as well as kilonova, and predict possible kilonova afterglows in a magnetar central engine.


title: Testing Higher Derivative Gravity Through Tunnelling

abstract: Higher derivative terms in the gravitational action are natural from the perspective of quantum gravity, but are perceived as leading to a lack of well-posedness. The Gauss Bonnet term has second-order equations of motion, but does not impact gravitational dynamics in 4D, so one might expect that it is not physically relevant. We discuss how signatures can show up in tunnelling processes and whether these will likely be physically accessible in Higgs vacuum decay.


title: The Elusive member of the Ti-Al-C MAX family- Ti4AlC3

abstract: We report here perhaps the first successful synthesis and structural characterization of the n=3 family member of Tin+1AlCn, i. e. Ti4AlC3. X-ray Powder diffraction (XRD) data shows characteristic reflections of from corresponding to reflections from the (002), (004), (006), (008), (100), (102), (104), (0010), (105), (106), (0012), (1011) and (1012) planes at 2{\theta} =7.640, 15.170, 22.760, 30.50, 350, 37.40 38.30, 39.20, 41.30, 46.220, 55.240, 58.620 and 60.780 (double structure) respectively. Rietveld refinement of the XRD data reveals a phase purity of about 79 % for alpha-Ti4AlC3, 15 % for beta-Ti4AlC3 and the rest mostly that of cubic TiC (6 %). The primary crystal symmetry of the two dominant phases is the hexagonal P63/mmc. The precursors chosen were TiH2, Al metal powder and Carbon powder in a molar ratio of 3:1.2:2, which build the case for an Al-deficient condition. We adopted the pressureless sintering technique at 13500 C with a dwelling time of 4 hours under ultra-high vacuum of 10-7 mbar. The co-existence of trace amount of Ti2AlC at 1350 deg C is proven by the small structure at 2{\theta}=13.130. No trace of oxides like Al2O3 or TiO2 was found in the end product. The line profile width of XRD data indicates average grain size of the order of micro meter. The Scanning Electron Microscopy images show highly lamellar stacked growth of almost a pure MAX (alpha or beta) phase and grain size of micron order, agreeing well with the XRD data.


title: Towards quantum gravity with neural networks: Solving the quantum Hamilton constraint of U(1) BF theory

abstract: In the canonical approach of loop quantum gravity, arguably the most important outstanding problem is finding and interpreting solutions to the Hamiltonian constraint. In this work, we demonstrate that methods of machine learning are in principle applicable to this problem. We consider U(1) BF theory in 3 dimensions, quantized with loop quantum gravity methods. In particular, we formulate a master constraint corresponding to Hamilton and Gauss constraints using loop quantum gravity methods. To make the problem amenable for numerical simulation we fix a graph and introduce a cutoff on the kinematical degrees of freedom, effectively considering U$_q$(1) BF theory at a root of unity. We show that the Neural Network Quantum State (NNQS) ansatz can be used to numerically solve the constraints efficiently and accurately. We compute expectation values and fluctuations of certain observables and compare them with exact results or exact numerical methods where possible. We also study the dependence on the cutoff.


title: Stars, bow shocks, and gamma-ray sources

abstract: Here I present a somewhat personal review of the results of my research carried out in the last couple of decades, mostly focused on the fields of stellar astrophysics, the interstellar medium, and the high energy sources. They have been obtained mainly from dedicated interferometric observations in the radio band at low frequencies of the electromagnetic spectrum.


title: Functional principal component analysis as an alternative to mixed-effect models for describing sparse repeated measures in presence of missing data

abstract: Analyzing longitudinal data in health studies is challenging due to sparse and error-prone measurements, strong within-individual correlation, missing data and various trajectory shapes. While mixed-effect models (MM) effectively address these challenges, they remain parametric models and may incur computational costs. In contrast, Functional Principal Component Analysis (FPCA) is a non-parametric approach developed for regular and dense functional data that flexibly describes temporal trajectories at a lower computational cost. This paper presents an empirical simulation study evaluating the behaviour of FPCA with sparse and error-prone repeated measures and its robustness under different missing data schemes in comparison with MM. The results show that FPCA is well-suited in the presence of missing at random data caused by dropout, except in scenarios involving most frequent and systematic dropout. Like MM, FPCA fails under missing not at random mechanism. The FPCA was applied to describe the trajectories of four cognitive functions before clinical dementia and contrast them with those of matched controls in a case-control study nested in a population-based aging cohort. The average cognitive declines of future dementia cases showed a sudden divergence from those of their matched controls with a sharp acceleration 5 to 2.5 years prior to diagnosis.


title: Enhanced Long Wavelength Mermin-Wagner Fluctuations in Two-Dimensional Active Crystals and Glasses

abstract: In the realm of two-dimensional (2D) systems, the renowned Mermin-Wagner effect plays a significant role, giving rise to striking dimensionality effects marked by far-reaching density fluctuations and the divergence of various dynamic properties. This effect also unequivocally negates the possibility of stable crystalline phases in 2D particulate systems characterized by continuous degrees of freedom. This effect has been recently discerned in glass-forming liquids, displaying characteristic signatures like the logarithmic divergence of mean squared displacement in the plateau regime. We explored these long-wavelength fluctuations in crystalline solids and in glass-forming liquids in the presence of non-equilibrium active forces. These systems are known in the literature as active crystals and glasses, and they can be thought of as a minimalistic model for understanding various non-equilibrium systems where the constituent particles dynamics are controlled by both temperature and other active forces, which can be external or internal. Such models often offer valuable insights into the dynamical behavior of biological systems, such as collections of cells, bacteria, ant colonies, or even synthetic self-propelled particles like Janus colloids. Our study reveals that fluctuations stemming from active forces get strongly coupled with long wavelength fluctuations arising from thermal effects, resulting in dramatic dynamical effects, particularly in 2D systems. We also shed light on how these fluctuations impact dynamical heterogeneity, a defining characteristic of glassy dynamics.


title: Robust Beamforming for RIS-aided Communications: Gradient-based Manifold Meta Learning

abstract: Reconfigurable intelligent surface (RIS) has become a promising technology to realize the programmable wireless environment via steering the incident signal in fully customizable ways. However, a major challenge in RIS-aided communication systems is the simultaneous design of the precoding matrix at the base station (BS) and the phase shifting matrix of the RIS elements. This is mainly attributed to the highly non-convex optimization space of variables at both the BS and the RIS, and the diversity of communication environments. Generally, traditional optimization methods for this problem suffer from the high complexity, while existing deep learning based methods are lack of robustness in various scenarios. To address these issues, we introduce a gradient-based manifold meta learning method (GMML), which works without pre-training and has strong robustness for RIS-aided communications. Specifically, the proposed method fuses meta learning and manifold learning to improve the overall spectral efficiency, and reduce the overhead of the high-dimensional signal process. Unlike traditional deep learning based methods which directly take channel state information as input, GMML feeds the gradients of the precoding matrix and phase shifting matrix into neural networks. Coherently, we design a differential regulator to constrain the phase shifting matrix of the RIS. Numerical results show that the proposed GMML can improve the spectral efficiency by up to 7.31\%, and speed up the convergence by 23 times faster compared to traditional approaches. Moreover, they also demonstrate remarkable robustness and adaptability in dynamic settings.


title: Alphabet Reduction for Reconfiguration Problems

abstract: We present a reconfiguration analogue of alphabet reduction \`a la Dinur (J. ACM, 2007) and its applications. Given a binary constraint graph $G$ and its two satisfying assignments $\psi^\mathsf{ini}$ and $\psi^\mathsf{tar}$, the Maxmin Binary CSP Reconfiguration problem requests to transform $\psi^\mathsf{ini}$ into $\psi^\mathsf{tar}$ by repeatedly changing the value of a single vertex so that the minimum fraction of satisfied edges is maximized. We demonstrate a polynomial-time reduction from Maxmin Binary CSP Reconfiguration with arbitrarily large alphabet size $W \in \mathbb{N}$ to itself with universal alphabet size $W_0 \in \mathbb{N}$ such that 1. the perfect completeness is preserved, and 2. if any reconfiguration for the former violates $\varepsilon$-fraction of edges, then $\Omega(\varepsilon)$-fraction of edges must be unsatisfied during any reconfiguration for the latter. The crux of its construction is the reconfigurability of Hadamard codes, which enables to reconfigure between a pair of codewords, while avoiding getting too close to the other codewords. Combining this alphabet reduction with gap amplification due to Ohsaka (SODA 2024), we are able to amplify the $1$ vs. $1-\varepsilon$ gap for arbitrarily small $\varepsilon \in (0,1)$ up to the $1$ vs. $1-\varepsilon_0$ for some universal $\varepsilon_0 \in (0,1)$ without blowing up the alphabet size. In particular, a $1$ vs. $1-\varepsilon_0$ gap version of Maxmin Binary CSP Reconfiguration with alphabet size $W_0$ is PSPACE-hard only assuming the Reconfiguration Inapproximability Hypothesis posed by Ohsaka (STACS 2023), whose gap parameter can be arbitrarily small. This may not be achieved only by gap amplification of Ohsaka, which makes the alphabet size gigantic depending on the gap value of the hypothesis.


title: FairSync: Ensuring Amortized Group Exposure in Distributed Recommendation Retrieval

abstract: In pursuit of fairness and balanced development, recommender systems (RS) often prioritize group fairness, ensuring that specific groups maintain a minimum level of exposure over a given period. For example, RS platforms aim to ensure adequate exposure for new providers or specific categories of items according to their needs. Modern industry RS usually adopts a two-stage pipeline: stage-1 (retrieval stage) retrieves hundreds of candidates from millions of items distributed across various servers, and stage-2 (ranking stage) focuses on presenting a small-size but accurate selection from items chosen in stage-1. Existing efforts for ensuring amortized group exposures focus on stage-2, however, stage-1 is also critical for the task. Without a high-quality set of candidates, the stage-2 ranker cannot ensure the required exposure of groups. Previous fairness-aware works designed for stage-2 typically require accessing and traversing all items. In stage-1, however, millions of items are distributively stored in servers, making it infeasible to traverse all of them. How to ensure group exposures in the distributed retrieval process is a challenging question. To address this issue, we introduce a model named FairSync, which transforms the problem into a constrained distributed optimization problem. Specifically, FairSync resolves the issue by moving it to the dual space, where a central node aggregates historical fairness data into a vector and distributes it to all servers. To trade off the efficiency and accuracy, the gradient descent technique is used to periodically update the parameter of the dual vector. The experiment results on two public recommender retrieval datasets showcased that FairSync outperformed all the baselines, achieving the desired minimum level of exposures while maintaining a high level of retrieval accuracy.


title: M1 Radiative and spin-nonflip $\pi\pi$ transitions of $B_c$ states in the Cornell potential model

abstract: In this paper, we mainly predict the rates of M1 radiative and spin-nonflip $\pi\pi$ transitions of $B_{c}$-meson under the non-relativistic Cornell potential model with a screening potential effect. We employ the numerical wave function to determine the M1 radiative transition widths of $B_c$ excited states and utilize the Kuang-Yan proposed method for the spin-nonflip $\pi\pi$ transitions among $B_c$ states. Our theoretical results are valuable for studying the M1 radiative and spin-nonflip $\pi\pi$ transition processes of $B_c$ states in experiments.


title: Reduced inequalities for vector-valued functions

abstract: Building on the notion of convex body domination introduced by Nazarov, Petermichl, Treil, and Volberg, we provide a general principle of bootstrapping bilinear estimates for scalar-valued functions into vector-valued versions with a reduced right-hand side involving iterated norms of a pointwise dot product $\vec f(x)\cdot\vec g(y)$ instead of the product of lengths $|\vec f(x)| |\vec g(y)|$ that would result from a na\"ive extension of the scalar inequality. On the way, we study connections between convex body domination and tensor norms. In order to cover the full regime of $L^p$ norms, also with $p<1$, that naturally arise in bilinear harmonic analysis, we develop a framework in general quasi-normed spaces. A key application is a vector-valued Kato-Ponce inequality (or fractional Leibnitz rule) with a reduced right-hand side, which we obtain as a soft corollary of the known scalar-valued version and our general bootstrapping method.


title: BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation

abstract: The upscaling of Large Language Models (LLMs) has yielded impressive advances in natural language processing, yet it also poses significant deployment challenges. Weight quantization has emerged as a widely embraced solution to reduce memory and computational demands. This paper introduces BitDistiller, a framework that synergizes Quantization-Aware Training (QAT) with Knowledge Distillation (KD) to boost the performance of LLMs at ultra-low precisions (sub-4-bit). Specifically, BitDistiller first incorporates a tailored asymmetric quantization and clipping technique to maximally preserve the fidelity of quantized weights, and then proposes a novel Confidence-Aware Kullback-Leibler Divergence (CAKLD) objective, which is employed in a self-distillation manner to enable faster convergence and superior model performance. Empirical evaluations demonstrate that BitDistiller significantly surpasses existing methods in both 3-bit and 2-bit configurations on general language understanding and complex reasoning benchmarks. Notably, BitDistiller is shown to be more cost-effective, demanding fewer data and training resources. The code is available at https://github.com/DD-DuDa/BitDistiller.


title: A reduction theorem for the Character Triple Conjecture

abstract: In this paper, we show that the Character Triple Conjecture holds for all finite groups once assumed for all quasi-simple groups. This answers the question on the existence of a self-reducing form of Dade's conjecture, a problem that was long investigated by Dade in the 1990s. Our result shows that this role is played by the Character Triple Conjecture, recently introduced by Sp\"ath, that we present here in a general form free of all previously imposed restrictions.


title: Crossing number of graphs and $\mathsf{\Delta Y}$-move

abstract: The crossing number of a graph is the minimum number of double points over all generic immersions of the graph into the plane. In this paper we investigate the behavior of crossing number under a graph transformation, called $\mathsf{\Delta Y}$-move, on the complete graph $K_n$. Concretely it is shown that for any $k\in \mathbb{N}$, there exist a natural number $n$ and a sequence of $\mathsf{\Delta Y}$-moves $K_n\rightarrow G^{(1)}\rightarrow \cdots \rightarrow G^{(k)}$ which is decreasing with respect to the crossing number. We also discuss the decrease of crossing number for relatively small $n$.


title: Graph-based Forecasting with Missing Data through Spatiotemporal Downsampling

abstract: Given a set of synchronous time series, each associated with a sensor-point in space and characterized by inter-series relationships, the problem of spatiotemporal forecasting consists of predicting future observations for each point. Spatiotemporal graph neural networks achieve striking results by representing the relationships across time series as a graph. Nonetheless, most existing methods rely on the often unrealistic assumption that inputs are always available and fail to capture hidden spatiotemporal dynamics when part of the data is missing. In this work, we tackle this problem through hierarchical spatiotemporal downsampling. The input time series are progressively coarsened over time and space, obtaining a pool of representations that capture heterogeneous temporal and spatial dynamics. Conditioned on observations and missing data patterns, such representations are combined by an interpretable attention mechanism to generate the forecasts. Our approach outperforms state-of-the-art methods on synthetic and real-world benchmarks under different missing data distributions, particularly in the presence of contiguous blocks of missing values.


title: ContiFormer: Continuous-Time Transformer for Irregular Time Series Modeling

abstract: Modeling continuous-time dynamics on irregular time series is critical to account for data evolution and correlations that occur continuously. Traditional methods including recurrent neural networks or Transformer models leverage inductive bias via powerful neural architectures to capture complex patterns. However, due to their discrete characteristic, they have limitations in generalizing to continuous-time data paradigms. Though neural ordinary differential equations (Neural ODEs) and their variants have shown promising results in dealing with irregular time series, they often fail to capture the intricate correlations within these sequences. It is challenging yet demanding to concurrently model the relationship between input data points and capture the dynamic changes of the continuous-time system. To tackle this problem, we propose ContiFormer that extends the relation modeling of vanilla Transformer to the continuous-time domain, which explicitly incorporates the modeling abilities of continuous dynamics of Neural ODEs with the attention mechanism of Transformers. We mathematically characterize the expressive power of ContiFormer and illustrate that, by curated designs of function hypothesis, many Transformer variants specialized in irregular time series modeling can be covered as a special case of ContiFormer. A wide range of experiments on both synthetic and real-world datasets have illustrated the superior modeling capacities and prediction performance of ContiFormer on irregular time series data. The project link is https://seqml.github.io/contiformer/.


title: PEGASUS: Personalized Generative 3D Avatars with Composable Attributes

abstract: We present PEGASUS, a method for constructing a personalized generative 3D face avatar from monocular video sources. Our generative 3D avatar enables disentangled controls to selectively alter the facial attributes (e.g., hair or nose) while preserving the identity. Our approach consists of two stages: synthetic database generation and constructing a personalized generative avatar. We generate a synthetic video collection of the target identity with varying facial attributes, where the videos are synthesized by borrowing the attributes from monocular videos of diverse identities. Then, we build a person-specific generative 3D avatar that can modify its attributes continuously while preserving its identity. Through extensive experiments, we demonstrate that our method of generating a synthetic database and creating a 3D generative avatar is the most effective in preserving identity while achieving high realism. Subsequently, we introduce a zero-shot approach to achieve the same goal of generative modeling more efficiently by leveraging a previously constructed personalized generative model.


title: Fragmentation of Stability Domains of Dark Solitons and Dark Breathers and Drifting Solitons at High Pump Intensities in Normal Dispersion Kerr Microresonators

abstract: Stability domains (i.e. pump frequency detuning range) of a single dark soliton (or platicon) and dark breather in high-Q Kerr optical microresonators with normal group velocity dispersion is studied for a wide range of pump amplitudes within the framework of the Lugiato-Lefever model. The effect of the significant fragmentation of the stability domains at high pump intensities is revealed. The existence of stable drifting dark solitons (platicons) is demonstrated above the threshold pump amplitude value. Properties of drifting solitons are investigated.


title: Relaxation and noise-driven oscillations in a model of mitotic spindle dynamics

abstract: During cell division, the mitotic spindle moves dynamically through the cell to position the chromosomes and determine the ultimate spatial position of the two daughter cells. These movements have been attributed to the action of cortical force generators which pull on the astral microtubules to position the spindle, as well as pushing events by these same microtubules against the cell cortex and membrane. Attachment and detachment of cortical force generators working antagonistically against centring forces of microtubules have been modelled previously (Grill et al. 2005, Phys. Rev. Lett. 94:108104) via stochastic simulations and Fokker-Planck equations to predict oscillations of a spindle pole in one spatial dimension. Using systematic asymptotic methods, we reduce the Fokker-Planck system to a set of ordinary differential equations (ODEs), consistent with a set proposed by Grill et al., which provide accurate predictions of the conditions for the Fokker-Planck system to exhibit oscillations. In the limit of small restoring forces, we derive an algebraic prediction of the amplitude of spindle-pole oscillations and demonstrate the relaxation structure of nonlinear oscillations. We also show how noise-induced oscillations can arise in stochastic simulations for conditions in which the Fokker-Planck system predicts stability, but for which the period can be estimated directly by the ODE model.


title: Generalizability of Mixture of Domain-Specific Adapters from the Lens of Signed Weight Directions and its Application to Effective Model Pruning

abstract: Several parameter-efficient fine-tuning methods based on adapters have been proposed as a streamlined approach to incorporate not only a single specialized knowledge into existing Pre-Trained Language Models (PLMs) but also multiple of them at once. Recent works such as AdapterSoup propose to mix not all but only a selective sub-set of domain-specific adapters during inference via model weight averaging to optimize performance on novel, unseen domains with excellent computational efficiency. However, the essential generalizability of this emerging weight-space adapter mixing mechanism on \textit{unseen, in-domain examples} remains unexplored. Thus, in this study, we conduct a comprehensive analysis to elucidate the generalizability of domain-specific adapter mixtures in in-domain evaluation. We also provide investigations into the inner workings of the mixture of domain-specific adapters by analyzing their weight signs, yielding critical analysis on the negative correlation between their fraction of weight sign difference and their mixtures' generalizability.


title: Yoneda lemma and representation theorem for double categories

abstract: We study (vertically) normal lax double functors valued in the weak double category $\mathbb{C}\mathrm{at}$ of small categories, functors, profunctors and natural transformations, which we refer to as lax double presheaves. We show that for the theory of double categories they play a similar role as 2-functors valued in $\mathrm{Cat}$ for 2-categories. We first introduce representable lax double presheaves and establish a Yoneda lemma. Then we build a Grothendieck construction which gives a 2-equivalence between lax double presheaves and discrete double fibrations over a fixed double category. Finally, we prove a representation theorem showing that a lax double presheaf is represented by an object if and only if its Grothendieck construction has a double terminal object.


title: A Predictive Surrogate Model for Heat Transfer of an Impinging Jet on a Concave Surface

abstract: This paper aims to comprehensively investigate the efficacy of various Model Order Reduction (MOR) and deep learning techniques in predicting heat transfer in a pulsed jet impinging on a concave surface. Expanding on the previous experimental and numerical research involving pulsed circular jets, this investigation extends to evaluate Predictive Surrogate Models (PSM) for heat transfer across various jet characteristics. To this end, this work introduces two predictive approaches, one employing a Fast Fourier Transformation augmented Artificial Neural Network (FFT-ANN) for predicting the average Nusselt number under constant-frequency scenarios. Moreover, the investigation introduces the Proper Orthogonal Decomposition and Long Short-Term Memory (POD-LSTM) approach for random-frequency impingement jets. The POD-LSTM method proves to be a robust solution for predicting the local heat transfer rate under random-frequency impingement scenarios, capturing both the trend and value of temporal modes. The comparison of these approaches highlights the versatility and efficacy of advanced machine learning techniques in modelling complex heat transfer phenomena.


title: Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Model

abstract: Recently, Denoising Diffusion Probabilistic Models (DDPMs) have attained leading performances across a diverse range of generative tasks. However, in the field of speech synthesis, although DDPMs exhibit impressive performance, their long training duration and substantial inference costs hinder practical deployment. Existing approaches primarily focus on enhancing inference speed, while approaches to accelerate training a key factor in the costs associated with adding or customizing voices often necessitate complex modifications to the model, compromising their universal applicability. To address the aforementioned challenges, we propose an inquiry: is it possible to enhance the training/inference speed and performance of DDPMs by modifying the speech signal itself? In this paper, we double the training and inference speed of Speech DDPMs by simply redirecting the generative target to the wavelet domain. This method not only achieves comparable or superior performance to the original model in speech synthesis tasks but also demonstrates its versatility. By investigating and utilizing different wavelet bases, our approach proves effective not just in speech synthesis, but also in speech enhancement.


title: `Keep it Together': Enforcing Cohesion in Extractive Summaries by Simulating Human Memory

abstract: Extractive summaries are usually presented as lists of sentences with no expected cohesion between them. In this paper, we aim to enforce cohesion whilst controlling for informativeness and redundancy in summaries, in cases where the input exhibits high redundancy. The pipeline controls for redundancy in long inputs as it is consumed, and balances informativeness and cohesion during sentence selection. Our sentence selector simulates human memory to keep track of topics --modeled as lexical chains--, enforcing cohesive ties between noun phrases. Across a variety of domains, our experiments revealed that it is possible to extract highly cohesive summaries that nevertheless read as informative to humans as summaries extracted by only accounting for informativeness or redundancy. The extracted summaries exhibit smooth topic transitions between sentences as signaled by lexical chains, with chains spanning adjacent or near-adjacent sentences.


title: Linear Transformers with Learnable Kernel Functions are Better In-Context Models

abstract: Advancing the frontier of subquadratic architectures for Language Models (LMs) is crucial in the rapidly evolving field of natural language processing. Current innovations, including State Space Models, were initially celebrated for surpassing Transformer performance on language modeling tasks. However, these models have revealed deficiencies in essential In-Context Learning capabilities - a domain where the Transformer traditionally shines. The Based model emerged as a hybrid solution, blending a Linear Transformer with a kernel inspired by the Taylor expansion of exponential functions, augmented by convolutional networks. Mirroring the Transformer's in-context adeptness, it became a strong contender in the field. In our work, we present a singular, elegant alteration to the Based kernel that amplifies its In-Context Learning abilities evaluated with the Multi-Query Associative Recall task and overall language modeling process, as demonstrated on the Pile dataset.


title: Can Separators Improve Chain-of-Thought Prompting?

abstract: Chain-of-thought (CoT) prompting is a simple and effective method for improving the reasoning capabilities of Large language models (LLMs). The basic idea of CoT is to let LLMs break down their thought processes step-by-step by putting exemplars in the input prompt. However, the densely structured prompt exemplars of CoT may cause the cognitive overload of LLMs. Inspired by human cognition, we introduce CoT-Sep, a novel method that strategically employs separators at the end of each exemplar in CoT prompting. These separators are designed to help the LLMs understand their thought processes better while reasoning. It turns out that CoT-Sep significantly improves the LLMs' performances on complex reasoning tasks (e.g., GSM-8K, AQuA, CSQA), compared with the vanilla CoT, which does not use separators. We also study the effects of the type and the location of separators tested on multiple LLMs, including GPT-3.5-Turbo, GPT-4, and LLaMA-2 7B. Interestingly, the type/location of separators should be chosen appropriately to boost the reasoning capability of CoT.


title: AbsInstruct: Eliciting Abstraction Ability from LLMs through Explanation Tuning with Plausibility Estimation

abstract: Abstraction ability is crucial in human intelligence, which can also benefit various tasks in NLP study. Existing work shows that LLMs are deficient in abstract ability, and how to improve it remains unexplored. In this work, we design the framework AbsInstruct to enhance LLMs' abstraction ability through instruction tuning. The framework builds instructions with in-depth explanations to assist LLMs in capturing the underlying rationale of abstraction. Meanwhile, we introduce a plausibility estimator to select instructions that are more consistent with the abstraction knowledge of LLMs to be aligned. Then, our framework combines abstraction instructions with general-purpose ones to build a hybrid dataset. Extensive experiments and analyses demonstrate that our framework can considerably enhance LLMs' abstraction ability with strong generalization performance while maintaining their general instruction-following abilities.


title: X-ray Linear Dichroic Tomography of Crystallographic and Topological Defects

abstract: The functionality of materials is determined by their composition and microstructure, that is, the distribution and orientation of crystalline grains, grain boundaries and the defects within them. The characterisation of the material's microstructure is therefore critical for materials applications such as catalysis, energy storage and buildings. Until now, characterization techniques that map the distribution of grains, their orientation, and the presence of defects have either been limited to surface investigations, to spatial resolutions of a few hundred nanometres, or to systems of thickness around one hundred nanometres, thus requiring destructive sample preparation for measurements and preventing the study of system-representative volumes or the investigation of materials under operational conditions. Here, we present X-ray linear dichroic orientation tomography, a quantitative, non-invasive technique that allows for an intra- and inter-granular characterisation of extended polycrystalline and amorphous materials in three dimensions (3D). We present the detailed characterisation of a polycrystalline sample of vanadium pentoxide (V2O5), a key catalyst in the production of sulfuric acid. In addition to determining the nanoscale composition, we map the crystal orientation throughout the polycrystalline sample with 73 nm spatial resolution. We identify grains, as well as twist, tilt, and twin grain boundaries. We further observe the creation and annihilation of topological defects promoted by the presence of volume crystallographic defects in 3D. Our method's non-destructive and spectroscopic nature opens the door to in-operando combined chemical and microstructural investigations of functional materials, including energy and mechanical materials in existing industries, as well as quantum materials for future technologies.


title: Polynomial functors on flags

abstract: We study generalizations of Schur functors from categories consisting of flags of vector spaces. We give different descriptions of the category of such functors in terms of representations of certain combinatorial categories and infinite rank groups, and we apply these descriptions to study polynomial representations and representation stability of parabolic subgroups of general linear groups.


title: Hermite Neural Network Simulation for Solving the 2D Schrodinger Equation

abstract: The Schrodinger equation is a mathematical equation describing the wave function's behavior in a quantum-mechanical system. It is a partial differential equation that provides valuable insights into the fundamental principles of quantum mechanics. In this paper, the aim was to solve the Schrodinger equation with sufficient accuracy by using a mixture of neural networks with the collocation method base Hermite functions. Initially, the Hermite functions roots were employed as collocation points, enhancing the efficiency of the solution. The Schrodinger equation is defined in an infinite domain, the use of Hermite functions as activation functions resulted in excellent precision. Finally, the proposed method was simulated using MATLAB's Simulink tool. The results were then compared with those obtained using Physics-informed neural networks and the presented method.


title: Temperature dependence of the bandgap of Eu doped {ZnCdO/ZnO}30 multilayer structures

abstract: In situ Eu-doped {ZnCdO/ZnO}30 multilayer systems were grown on p-type Si-substrates and on quartz substrates by plasma-assisted molecular beam epitaxy. Various Eu concentrations in the samples were achieved by controlling temperature of the europium effusion cell. The properties of as-grown and annealed {ZnCdO/ZnO}30:Eu multilayers were investigated using secondary ion mass spectrometry (SIMS) and X-ray diffraction methods. SIMS measurements showed that annealing at 700{\deg}C and 900{\deg}C practically did not change the Eu concentration and the rare earth depth profiles are uniform. It was found that the band gap depends on the concentration of Eu and it was changed by rapid thermal annealing. Varshni and Bose-Einstein equations were used to describe the temperature dependence of the band gap of {ZnCdO/ZnO}30:Eu multilayer structures and Debye and Einstein temperatures were obtained.


title: Quantum dimer models with Rydberg gadgets

abstract: The Rydberg blockade mechanism is an important ingredient in quantum simulators based on neutral atom arrays. It enables the emergence of a rich variety of quantum phases of matter, such as topological spin liquids. The typically isotropic nature of the blockade effect, however, restricts the range of natively accessible models and quantum states. In this work, we propose a method to systematically overcome this limitation, by developing gadgets, i.e., specific arrangements of atoms, that transform the underlying Rydberg blockade into more general constraints. We apply this technique to realize dimer models on square and triangular geometries. In these setups, we study the role of the quantum fluctuations induced by a coherent drive of the atoms and find signatures of $U(1)$ and $\mathbb{Z}_2$ quantum spin liquid states in the respective ground states. Finally, we show that these states can be dynamically prepared with high fidelity, paving the way for the quantum simulation of a broader class of constrained models and topological matter in experiments with Rydberg atom arrays.

categories: quant-ph cond-mat.quant-gas cond-mat.str-el physics.atom-ph


title: A Gauss-Newton method for iterative optimization of memory kernels for generalized Langevin thermostats in coarse-grained molecular dynamics simulations

abstract: In molecular dynamics simulations, dynamically consistent coarse-grained (CG) models commonly use stochastic thermostats to model friction and fluctuations that are lost in a CG description. While Markovian, i.e., time-local, formulations of such thermostats allow for an accurate representation of diffusivities/long-time dynamics, a correct description of the dynamics on all time scales generally requires non-Markovian, i.e., non-time-local, thermostats. These thermostats are typically in the form of a Generalized Langevin Equation (GLE) determined by a memory kernel. In this work, we use a Markovian embedded formulation of a position-independent GLE thermostat acting independently on each CG degree of freedom. Extracting the memory kernel of this CG model from atomistic reference data requires several approximations. Therefore, this task is best understood as an inverse problem. While our recently proposed approximate Newton scheme, Iterative Optimization of memory kernels (IOMK), allows for the iterative optimization of a memory kernel, Markovian embedding remained potentially error-prone and computationally expensive. In this work, we present a IOMK-Gauss-Newton scheme (IOMK-GN) based on IOMK, that allows for the direct parameterization of a Markovian embedded model.


title: Hilbert transforms and maximal functions along flat curves on the Heisenberg group

abstract: We establish the $L^p$ boundedness of Hilbert transforms and maximal functions along flat curves in the Heisenberg group. This generalizes the $\mathbb{R}^n$ result by Carbery, Christ, Vance, Wainger, and Watson. What is new about our result compared to the Heisenberg group generalization by Carbery, Wainger, and Wright is that we allow all three components of the curves to vary independently, we keep the original form of the conditions required in the $\mathbb{R}^n$ case, and our method is likely to be generalized to other stratified nilpotent groups.


title: Enhancing Numerical Reasoning with the Guidance of Reliable Reasoning Processes

abstract: Numerical reasoning is an essential ability for NLP systems to handle numeric information. Recent research indicates that fine-tuning a small-scale model to learn generating reasoning processes alongside answers can significantly enhance performance. However, current methods have the limitation that most methods generate reasoning processes with large language models (LLMs), which are "unreliable" since such processes could contain information unrelated to the answer. To address this limitation, we introduce Enhancing NumeriCal reasOning with Reliable procEsses (Encore), which derives the reliable reasoning process by decomposing the answer formula, ensuring which fully supports the answer. Nevertheless, models could lack enough data to learn the reasoning process generation adequately, since our method generates only one single reasoning process for one formula. To overcome this difficulty, we present a series of pre-training tasks to help models learn the reasoning process generation with synthesized data. The experiments show that Encore yields improvement on all five experimental datasets with an average of 1.8%, proving the effectiveness of our method.


title: An energy-based material model for the simulation of shape memory alloys under complex boundary value problems

abstract: Shape memory alloys are remarkable 'smart' materials used in a broad spectrum of applications, ranging from aerospace to robotics, thanks to their unique thermomechanical coupling capabilities. Given the complex properties of shape memory alloys, which are largely influenced by thermal and mechanical loads, as well as their loading history, predicting their behavior can be challenging. Consequently, there exists a pronounced demand for an efficient material model to simulate the behavior of these alloys. This paper introduces a material model rooted in Hamilton's principle. The key advantages of the presented material model encompass a more accurate depiction of the internal variable evolution and heightened robustness. As such, the proposed material model signifies an advancement in the realistic and efficient simulation of shape memory alloys.


title: Free-discontinuity problems generated by higher-order singular perturbations

abstract: We carry on an asymptotic analysis for a class of non-convex integral functionals with a singular perturbation by derivatives of order $k\ge 2$. In the case $k=2$ these functional have been already proved to converge to a free-discontinuity functional whose jump part energy density is a constant $m_2$ times the square root of the jump size by Alicandro et al.~and by Bouchitt\'e et al. We show that the $k$-th order perturbation gives a constant, $m_k$, times the $k$-th root of the jump size as the jump part energy density. The constant $m_k$ is characterized by an optimal-profile problem with zero derivatives up to order $k-1$ at the boundary. Contrary to the case $k=2$, the set of points where these boundary conditions hold are not naturally selected from the energy, and the main technical part of the paper is the analysis of the properties of such sets, carried on by a combined use of interpolation inequalities and energy estimates. The result is proven for truncated quadratic energy densities and in the one-dimensional case, from which the general higher-dimensional case can be obtained by slicing techniques and a wide class of non-convex energies can be studied as an envelope of the particular ones. Finally, we remark that an approximation of the Mumford-Shah functional can be obtained by letting $k\to+\infty$.


title: Existence of a minimizer to the particle number-Casimir functional for the Einstein-Vlasov system

abstract: In 2001 Wolansky \cite{Wol} introduced a particle number-Casimir functional for the Einstein-Vlasov system. Two open questions are associated with this functional. First, a meaningful variational problem should be formulated and the existence of a minimizer to this problem should be established. The second issue is to show that a minimizer, for some choice of the parameters, is a static solution of the Einstein-Vlasov system. In the present work we solve the first problem by proving the existence of a minimizer to the particle number-Casimir functional. On the technical side, it is a main achievement that we are able to bypass the non-compactness of minimizing sequences by new arguments in both $v$-space and $x$-space, which might have several further applications. We note that such compactness results for the Einstein-Vlasov system have been absent in the literature, whereas similar results have been known in the Newtonian case. We also provide arguments which give strong support that minimizers corresponding to small masses are static solutions of the Einstein-Vlasov system. Furthermore, our analysis leads us to propose a new stability criterion for static solutions: We conjecture that a static solution for which the Casimir-binding energy is positive is stable for mass-preserving perturbations.


title: Human-machine collaboration: ordering mechanism of rank$-2$ spin liquid on breathing pyrochlore lattice

abstract: Machine learning algorithms thrive on large data sets of good quality. Here we show that they can also excel in a typical research setting with little data of limited quality, through an interplay of insights coming from machine, and human researchers. The question we address is the unsolved problem of ordering out of a spin-liquid phase described by an emergent rank-2 $U(1)$ gauge theory, as described by [H. Yan it et al., Phys. Rev. Lett. 124, 127203 (2020)]. Published Monte Carlo simulations for this problem are consistent with a strong first-order phase transition, out of the R2-U1 spin liquid, but were too noisy for the form of low-temperature order to be identified. Using a highly-interpretable machine learning approach based on a support vector machine with a tensorial kernel (TKSVM), we re-analyze this Monte Carlo data, gaining new information about the form of order that could in turn be interpreted by traditionally-trained physicists. We find that the low-temperature ordered phase is a form of hybrid nematic order with emergent $Z_2$ symmetry, which allows for a sub-extensive set of domain walls at zero energy. This complex form of order arises due to a subtle thermal order-by-disorder mechanism, that can be understood from the fluctuations of the tensor electric field of the parent rank-2 gauge theory. These results were obtained by a back-and-forth process which closely resembles a collaboration between human researchers and machines. We argue that this "collaborative" approach may provide a blueprint for solving other problems that have not yielded to human insights alone.


title: Network Formation and Dynamics Among Multi-LLMs

abstract: Social networks shape opinions, behaviors, and information dissemination in human societies. As large language models (LLMs) increasingly integrate into social and professional environments, understanding their behavior within the context of social interactions and networks becomes essential. Our study analyzes LLMs' network formation behavior to examine whether the dynamics of multiple LLMs are similar to or different from human social dynamics. We observe that LLMs exhibit key social network principles, including preferential attachment, triadic closure, homophily, community structure, and the small-world phenomenon, when asked about their preferences in network formation. We also investigate LLMs' decision-making based on real-world networks, revealing that triadic closure and homophily have a stronger influence than preferential attachment and that LLMs perform well in network formation predictions. Overall, our study opens up new possibilities for using LLMs in network science research and helps develop socially aware LLMs by shedding light on their social interaction behaviors and exploring their impacts on social dynamics.


title: Power Allocation Scheme for Device-Free Localization in 6G ISAC Networks

abstract: Integrated Sensing and Communication (ISAC) is considered one of the crucial technologies in the upcoming sixth-generation (6G) mobile communication systems that could facilitate ultra-precise positioning of passive and active targets and extremely high data rates through spectrum coexistence and hardware sharing. Such an ISAC network offers a lot of benefits, but comes with the challenge of managing the mutual interference between the sensing and communication services. In this paper, we investigate the problem of localization accuracy in a monostatic ISAC network under consideration of inter-BS interference due to communication signal and sensing echoes, and self-interference at the respective BS. We propose a power allocation algorithm that minimizes BS's maximum range estimate error while considering minimum communication signal-to-interference-plus-noise ratio (SINR) and total power constraint. Our numerical results demonstrate the effectiveness of the proposed algorithm and indicate that it can enhance the sensing performance when the self-interference is effectively suppressed.


title: Exact decay of the persistence probability in the Airy$_1$ process

abstract: We consider the Airy$_1$ process, which is the limit process in KPZ growth models with flat and non-random initial conditions. We study the persistence probability, namely the probability that the process stays below a given threshold $c$ for a time span of length $L$. This is expected to decay as $e^{-\kappa(c) L}$. We determine an analytic expression for $\kappa(c)$ for all $c\geq 3/2$ starting with the continuum statistics formula for the persistence probability. As the formula is analytic only for $c>0$, we determine an analytic continuation of $\kappa(c)$ and numerically verify the validity for $c<0$ as well.


title: Fine Tuning Named Entity Extraction Models for the Fantasy Domain

abstract: Named Entity Recognition (NER) is a sequence classification Natural Language Processing task where entities are identified in the text and classified into predefined categories. It acts as a foundation for most information extraction systems. Dungeons and Dragons (D&D) is an open-ended tabletop fantasy game with its own diverse lore. DnD entities are domain-specific and are thus unrecognizable by even the state-of-the-art off-the-shelf NER systems as the NER systems are trained on general data for pre-defined categories such as: person (PERS), location (LOC), organization (ORG), and miscellaneous (MISC). For meaningful extraction of information from fantasy text, the entities need to be classified into domain-specific entity categories as well as the models be fine-tuned on a domain-relevant corpus. This work uses available lore of monsters in the D&D domain to fine-tune Trankit, which is a prolific NER framework that uses a pre-trained model for NER. Upon this training, the system acquires the ability to extract monster names from relevant domain documents under a novel NER tag. This work compares the accuracy of the monster name identification against; the zero-shot Trankit model and two FLAIR models. The fine-tuned Trankit model achieves an 87.86% F1 score surpassing all the other considered models.


title: Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQL

abstract: Currently, the in-context learning method based on large language models (LLMs) has become the mainstream of text-to-SQL research. Previous works have discussed how to select demonstrations related to the user question from a human-labeled demonstration pool. However, human labeling suffers from the limitations of insufficient diversity and high labeling overhead. Therefore, in this paper, we discuss how to measure and improve the diversity of the demonstrations for text-to-SQL. We present a metric to measure the diversity of the demonstrations and analyze the insufficient of the existing labeled data by experiments. Based on the above discovery, we propose fusing iteratively for demonstrations (Fused) to build a high-diversity demonstration pool through human-free multiple-iteration synthesis, improving diversity and lowering label cost. Our method achieves an average improvement of 3.2% and 5.0% with and without human labeling on several mainstream datasets, which proves the effectiveness of Fused.


title: Generative AI and Attentive User Interfaces: Five Strategies to Enhance Take-Over Quality in Automated Driving

abstract: As the automotive world moves toward higher levels of driving automation, Level 3 automated driving represents a critical juncture. In Level 3 driving, vehicles can drive alone under limited conditions, but drivers are expected to be ready to take over when the system requests. Assisting the driver to maintain an appropriate level of Situation Awareness (SA) in such contexts becomes a critical task. This position paper explores the potential of Attentive User Interfaces (AUIs) powered by generative Artificial Intelligence (AI) to address this need. Rather than relying on overt notifications, we argue that AUIs based on novel AI technologies such as large language models or diffusion models can be used to improve SA in an unconscious and subtle way without negative effects on drivers overall workload. Accordingly, we propose 5 strategies how generative AI s can be used to improve the quality of takeovers and, ultimately, road safety.


title: Selective Prediction for Semantic Segmentation using Post-Hoc Confidence Estimation and Its Performance under Distribution Shift

abstract: Semantic segmentation plays a crucial role in various computer vision applications, yet its efficacy is often hindered by the lack of high-quality labeled data. To address this challenge, a common strategy is to leverage models trained on data from different populations, such as publicly available datasets. This approach, however, leads to the distribution shift problem, presenting a reduced performance on the population of interest. In scenarios where model errors can have significant consequences, selective prediction methods offer a means to mitigate risks and reduce reliance on expert supervision. This paper investigates selective prediction for semantic segmentation in low-resource settings, thus focusing on post-hoc confidence estimators applied to pre-trained models operating under distribution shift. We propose a novel image-level confidence measure tailored for semantic segmentation and demonstrate its effectiveness through experiments on three medical imaging tasks. Our findings show that post-hoc confidence estimators offer a cost-effective approach to reducing the impacts of distribution shift.


title: Multi-Hop Table Retrieval for Open-Domain Text-to-SQL

abstract: Open-domain text-to-SQL is an important task that retrieves question-relevant tables from massive databases and then generates SQL. However, existing retrieval methods that retrieve in a single hop do not pay attention to the text-to-SQL challenge of schema linking, which is aligning the entities in the question with table entities, reflected in two aspects: similar irrelevant entity and domain mismatch entity. Therefore, we propose our method, the multi-hop table retrieval with rewrite and beam search (Murre). To reduce the effect of the similar irrelevant entity, our method focuses on unretrieved entities at each hop and considers the low-ranked tables by beam search. To alleviate the limitation of domain mismatch entity, Murre rewrites the question based on retrieved tables in multiple hops, decreasing the domain gap with relevant tables. We conduct experiments on SpiderUnion and BirdUnion+, reaching new state-of-the-art results with an average improvement of 6.38%.


title: Binary linear codes with a fixed point free permutation automorphism of order three

abstract: We investigate the structural properties of binary linear codes whose permutation automorphism group has a fixed point free automorphism of order $3$. We prove that up to dimension or codimension $4$, there is no binary linear code whose permutation automorphism group is generated by a fixed point free permutation of order $3$. We also prove that there is no binary $5$-dimensional linear code whose length is at least $30$ and whose permutation automorphism group is generated by a fixed point free permutation of order $3$.


title: Data-Driven Abstractions for Control Systems

abstract: At the intersection of dynamical systems, control theory, and formal methods lies the construction of symbolic abstractions: these typically represent simpler, finite-state models whose behaviour mimics the one of an underlying concrete system but are easier to analyse. Building an abstraction usually requires an accurate knowledge of the underlying model: this knowledge may be costly to gather, especially in real-life applications. We aim to bridge this gap by building abstractions based on sampling finite length trajectories. Adding the controller degrees of freedom, we newly define the notion of probabilistic alternating simulation, and provide probably approximately correct (PAC) guarantees that the constructed abstraction includes all behaviours of the concrete system and that it is suitable for control design, for arbitrarily long time horizons, leveraging the scenario theory. Our method is then tested on several numerical benchmarks.


title: Humans or LLMs as the Judge? A Study on Judgement Biases

abstract: Adopting human and large language models (LLM) as judges (\textit{a.k.a} human- and LLM-as-a-judge) for evaluating the performance of LLMs has recently gained attention. Nonetheless, this approach concurrently introduces potential biases from human and LLM judges, questioning the reliability of the evaluation results. In this paper, we propose a novel framework that is free from referencing groundtruth annotations for investigating Fallacy Oversight Bias, Authority Bias and Beauty Bias on LLM and human judges. We curate a dataset referring to the revised Bloom's Taxonomy and conduct thousands of human and LLM evaluations. Results show that human and LLM judges are vulnerable to perturbations to various degrees, and that even the cutting-edge judges possess considerable biases. We further exploit their weakness and conduct attacks on LLM judges. We hope that our work can notify the community of the vulnerability of human- and LLM-as-a-judge against perturbations, as well as the urgency of developing robust evaluation systems.


title: OpenFMNav: Towards Open-Set Zero-Shot Object Navigation via Vision-Language Foundation Models

abstract: Object navigation (ObjectNav) requires an agent to navigate through unseen environments to find queried objects. Many previous methods attempted to solve this task by relying on supervised or reinforcement learning, where they are trained on limited household datasets with close-set objects. However, two key challenges are unsolved: understanding free-form natural language instructions that demand open-set objects, and generalizing to new environments in a zero-shot manner. Aiming to solve the two challenges, in this paper, we propose OpenFMNav, an Open-set Foundation Model based framework for zero-shot object Navigation. We first unleash the reasoning abilities of large language models (LLMs) to extract proposed objects from natural language instructions that meet the user's demand. We then leverage the generalizability of large vision language models (VLMs) to actively discover and detect candidate objects from the scene, building a Versatile Semantic Score Map (VSSM). Then, by conducting common sense reasoning on VSSM, our method can perform effective language-guided exploration and exploitation of the scene and finally reach the goal. By leveraging the reasoning and generalizing abilities of foundation models, our method can understand free-form human instructions and perform effective open-set zero-shot navigation in diverse environments. Extensive experiments on the HM3D ObjectNav benchmark show that our method surpasses all the strong baselines on all metrics, proving our method's effectiveness. Furthermore, we perform real robot demonstrations to validate our method's open-set-ness and generalizability to real-world environments.


title: Decomposition for Enhancing Attention: Improving LLM-based Text-to-SQL through Workflow Paradigm

abstract: In-context learning of large-language models (LLMs) has achieved remarkable success in the field of natural language processing, while extensive case studies reveal that the single-step chain-of-thought prompting approach faces challenges such as attention diffusion and inadequate performance in complex tasks like text-to-SQL. To improve the contextual learning capabilities of LLMs in text-to-SQL, a workflow paradigm method is proposed, aiming to enhance the attention and problem-solving scope of LLMs through decomposition. Specifically, the information determination module for eliminating redundant information and the brand-new prompt structure based on problem classification greatly enhance the model's attention. Additionally, the inclusion of self-correction and active learning modules greatly expands the problem-solving scope of LLMs, hence improving the upper limit of LLM-based approaches. Extensive experiments conducted on three datasets demonstrate that our approach outperforms other methods by a significant margin. About 2-3 percentage point improvements compared to the existing baseline on the Spider Dev, Spider-Realistic, and Bird Dev datasets and new SOTA results on the Spider Test dataset are achieved. Our code is available on GitHub: \url{https://github.com/FlyingFeather/DEA-SQL}.


title: A note on weak compactness of occupation measures for an absorbing Markov decision process

abstract: We consider an absorbing Markov decision process with Borel state and action spaces. We study conditions under which the MDP is uniformly absorbing and the set of occupation measures of the MDP is compact in the usual weak topology. These include suitable continuity requirements on the transition kernel and conditions on the dynamics of the system at the boundary of the absorbing set. We generalize previously known results and give an answer to some conjectures that have been mentioned in the related literature.


title: Controlled light distribution with coupled microresonator chains via Kerr symmetry breaking

abstract: Within optical microresonators, the Kerr interaction of photons can lead to symmetry breaking of optical modes. In a ring resonator, this leads to the interesting effect that light preferably circulates in one direction or in one polarization state. Applications of this effect range from chip-integrated optical diodes to nonlinear polarization controllers and optical gyroscopes. In this work, we study Kerr-nonlinearity-induced symmetry breaking of light states in coupled resonator optical waveguides (CROWs). We discover a new type of controllable symmetry breaking that leads to emerging patterns of dark and bright resonators within the chains. Beyond stationary symmetry broken states, we observe periodic oscillations, switching and chaotic fluctuations of circulating powers in the resonators. Our findings are of interest for controlled multiplexing of light in photonic integrated circuits, neuromorphic computing, topological photonics and soliton frequency combs in coupled resonators.


title: Border subrank via a generalised Hilbert-Mumford criterion

abstract: We show that the border subrank of a sufficiently general tensor in $(\mathbb{C}^n)^{\otimes d}$ is $\mathcal{O}(n^{1/(d-1)})$ for $n \to \infty$. Since this matches the growth rate $\Theta(n^{1/(d-1)})$ for the generic (non-border) subrank recently established by Derksen-Makam-Zuiddam, we find that the generic border subrank has the same growth rate. In our proof, we use a generalisation of the Hilbert-Mumford criterion that we believe will be of independent interest.


title: German Text Simplification: Finetuning Large Language Models with Semi-Synthetic Data

abstract: This study pioneers the use of synthetically generated data for training generative models in document-level text simplification of German texts. We demonstrate the effectiveness of our approach with real-world online texts. Addressing the challenge of data scarcity in language simplification, we crawled professionally simplified German texts and synthesized a corpus using GPT-4. We finetune Large Language Models with up to 13 billion parameters on this data and evaluate their performance. This paper employs various methodologies for evaluation and demonstrates the limitations of currently used rule-based metrics. Both automatic and manual evaluations reveal that our models can significantly simplify real-world online texts, indicating the potential of synthetic data in improving text simplification.


title: Generating Plane Quadrangulations and Symmetry-preserving Operations on Maps

abstract: Lopsp-operations are operations on maps that are applied locally and are guaranteed to preserve all the orientation-preserving symmetries of maps. Well-known examples of such operations are dual, ambo, truncation, and leapfrog. They are described by plane 3-coloured triangulations with specific properties. We developed and implemented a program that can generate all lopsp-operations of a given size by reducing the problem of generating lopsp-operations to generating all plane quadrangulations that are not necessarily simple. We extended the program plantri to generate these quadrangulations.


title: Performance Gaps in Multi-view Clustering under the Nested Matrix-Tensor Model

abstract: We study the estimation of a planted signal hidden in a recently introduced nested matrix-tensor model, which is an extension of the classical spiked rank-one tensor model, motivated by multi-view clustering. Prior work has theoretically examined the performance of a tensor-based approach, which relies on finding a best rank-one approximation, a problem known to be computationally hard. A tractable alternative approach consists in computing instead the best rank-one (matrix) approximation of an unfolding of the observed tensor data, but its performance was hitherto unknown. We quantify here the performance gap between these two approaches, in particular by deriving the precise algorithmic threshold of the unfolding approach and demonstrating that it exhibits a BBP-type transition behavior. This work is therefore in line with recent contributions which deepen our understanding of why tensor-based methods surpass matrix-based methods in handling structured tensor data.