title: Corpus Considerations for Annotator Modeling and Scaling

abstract: Recent trends in natural language processing research and annotation tasks affirm a paradigm shift from the traditional reliance on a single ground truth to a focus on individual perspectives, particularly in subjective tasks. In scenarios where annotation tasks are meant to encompass diversity, models that solely rely on the majority class labels may inadvertently disregard valuable minority perspectives. This oversight could result in the omission of crucial information and, in a broader context, risk disrupting the balance within larger ecosystems. As the landscape of annotator modeling unfolds with diverse representation techniques, it becomes imperative to investigate their effectiveness with the fine-grained features of the datasets in view. This study systematically explores various annotator modeling techniques and compares their performance across seven corpora. From our findings, we show that the commonly used user token model consistently outperforms more complex models. We introduce a composite embedding approach and show distinct differences in which model performs best as a function of the agreement with a given dataset. Our findings shed light on the relationship between corpus statistics and annotator modeling performance, which informs future work on corpus construction and perspectivist NLP.


title: Fully chaotic conservative models for some torus homeomorphisms

abstract: We study homotopic-to-the-identity torus homeomorphisms, whose rotation set has nonempty interior. We prove that any such map is monotonically semiconjugate to a homeomorphism that preserves the Lebesgue measure, and that has the same rotation set. Furthermore, the dynamics of the quotient map has several interesting chaotic traits: for instance, it is topologically mixing, has a dense set of periodic points and is continuum-wise expansive. In particular, this shows that a convex compact set of $\mathbb{R}^2$ with nonempty interior is the rotation set of the lift of a homeomorphism of $\mathbb{T}^2$ if and only if it is the rotation set of the lift of a conservative homeomorphism.


title: A Computational Analysis of Lyric Similarity Perception

abstract: In musical compositions that include vocals, lyrics significantly contribute to artistic expression. Consequently, previous studies have introduced the concept of a recommendation system that suggests lyrics similar to a user's favorites or personalized preferences, aiding in the discovery of lyrics among millions of tracks. However, many of these systems do not fully consider human perceptions of lyric similarity, primarily due to limited research in this area. To bridge this gap, we conducted a comparative analysis of computational methods for modeling lyric similarity with human perception. Results indicated that computational models based on similarities between embeddings from pre-trained BERT-based models, the audio from which the lyrics are derived, and phonetic components are indicative of perceptual lyric similarity. This finding underscores the importance of semantic, stylistic, and phonetic similarities in human perception about lyric similarity. We anticipate that our findings will enhance the development of similarity-based lyric recommendation systems by offering pseudo-labels for neural network development and introducing objective evaluation metrics.


title: Improved model-free bounds for multi-asset options using option-implied information and deep learning

abstract: We consider the computation of model-free bounds for multi-asset options in a setting that combines dependence uncertainty with additional information on the dependence structure. More specifically, we consider the setting where the marginal distributions are known and partial information, in the form of known prices for multi-asset options, is also available in the market. We provide a fundamental theorem of asset pricing in this setting, as well as a superhedging duality that allows to transform the maximization problem over probability measures in a more tractable minimization problem over trading strategies. The latter is solved using a penalization approach combined with a deep learning approximation using artificial neural networks. The numerical method is fast and the computational time scales linearly with respect to the number of traded assets. We finally examine the significance of various pieces of additional information. Empirical evidence suggests that "relevant" information, i.e. prices of derivatives with the same payoff structure as the target payoff, are more useful that other information, and should be prioritized in view of the trade-off between accuracy and computational efficiency.


title: Generative AI-Based Effective Malware Detection for Embedded Computing Systems

abstract: One of the pivotal security threats for the embedded computing systems is malicious software a.k.a malware. With efficiency and efficacy, Machine Learning (ML) has been widely adopted for malware detection in recent times. Despite being efficient, the existing techniques require a tremendous number of benign and malware samples for training and modeling an efficient malware detector. Furthermore, such constraints limit the detection of emerging malware samples due to the lack of sufficient malware samples required for efficient training. To address such concerns, we introduce a code-aware data generation technique that generates multiple mutated samples of the limitedly seen malware by the devices. Loss minimization ensures that the generated samples closely mimic the limitedly seen malware and mitigate the impractical samples. Such developed malware is further incorporated into the training set to formulate the model that can efficiently detect the emerging malware despite having limited exposure. The experimental results demonstrates that the proposed technique achieves an accuracy of 90% in detecting limitedly seen malware, which is approximately 3x more than the accuracy attained by state-of-the-art techniques.


title: GaitSTR: Gait Recognition with Sequential Two-stream Refinement

abstract: Gait recognition aims to identify a person based on their walking sequences, serving as a useful biometric modality as it can be observed from long distances without requiring cooperation from the subject. In representing a person's walking sequence, silhouettes and skeletons are the two primary modalities used. Silhouette sequences lack detailed part information when overlapping occurs between different body segments and are affected by carried objects and clothing. Skeletons, comprising joints and bones connecting the joints, provide more accurate part information for different segments; however, they are sensitive to occlusions and low-quality images, causing inconsistencies in frame-wise results within a sequence. In this paper, we explore the use of a two-stream representation of skeletons for gait recognition, alongside silhouettes. By fusing the combined data of silhouettes and skeletons, we refine the two-stream skeletons, joints, and bones through self-correction in graph convolution, along with cross-modal correction with temporal consistency from silhouettes. We demonstrate that with refined skeletons, the performance of the gait recognition model can achieve further improvement on public gait recognition datasets compared with state-of-the-art methods without extra annotations.


title: A lattice Boltzmann approach for acoustic manipulation

abstract: We employ a lattice Boltzmann method to compute the acoustic radiation force produced by standing waves on a compressible object. Instead of simulating the fluid mechanics equations directly, the proposed method uses a lattice Boltzmann model that reproduces the wave equation, together with a kernel interpolation scheme, to compute the first order perturbations of the pressure and velocity fields on the object's surface and, from them, the acoustic radiation force. The procedure reproduces with excellent accuracy the theoretical expressions by Gor'kov and Wei for the sphere and the disk, respectively, even with a modest number of lattice Boltzmann cells. The proposed method shows to be a promising tool for simulating phenomena where the acoustic radiation force plays a relevant role, like acoustic tweezers or the acoustic manipulation of microswimmers, with applications in medicine and engineering.


title: Correlation and Spectral Density Functions in Mode-Stirred Reverberation -- I. Theory

abstract: Auto- and cross-spectral density functions for dynamic {random} fields and power are derived. These are based on first- and second-order Pad\'{e} approximants of correlation functions expanded in terms of spectral moments. The second-order approximant permits a characterization of stir noise observable {at high stir frequencies in the autospectral density}. A relationship between stir imperfection and spectral kurtosis is established. For the latter, lower bounds are established. A novel alternative measure of correlation time for mean-square differentiable fields is introduced as the lag at the first point of inflection in the autocorrelation function. A hierarchy of Pad\'{e} deviation coefficients is constructed that quantify imperfections of correlations and spectra with increasing accuracy and range of lags. Analytical models of the spectral densities are derived and their asymptotic behaviour is analyzed. The theoretical spectral density for the electric field as an input quantity is compared with that for power as the measurand. For the latter, its inverted-S shape conforms to experimentally observed stir-spectral power densities. The effect of additive noise on the stir autocorrelation and spectral density functions is quantified.


title: COVID-19 Detection Based on Blood Test Parameters using Various Artificial Intelligence Methods

abstract: In 2019, the world faced a new challenge: a COVID-19 disease caused by the novel coronavirus, SARS-CoV-2. The virus rapidly spread across the globe, leading to a high rate of mortality, which prompted health organizations to take measures to control its transmission. Early disease detection is crucial in the treatment process, and computer-based automatic detection systems have been developed to aid in this effort. These systems often rely on artificial intelligence (AI) approaches such as machine learning, neural networks, fuzzy systems, and deep learning to classify diseases. This study aimed to differentiate COVID-19 patients from others using self-categorizing classifiers and employing various AI methods. This study used two datasets: the blood test samples and radiography images. The best results for the blood test samples obtained from San Raphael Hospital, which include two classes of individuals, those with COVID-19 and those with non-COVID diseases, were achieved through the use of the Ensemble method (a combination of a neural network and two machines learning methods). The results showed that this approach for COVID-19 diagnosis is cost-effective and provides results in a shorter amount of time than other methods. The proposed model achieved an accuracy of 94.09% on the dataset used. Secondly, the radiographic images were divided into four classes: normal, viral pneumonia, ground glass opacity, and COVID-19 infection. These were used for segmentation and classification. The lung lobes were extracted from the images and then categorized into specific classes. We achieved an accuracy of 91.1% on the image dataset. Generally, this study highlights the potential of AI in detecting and managing COVID-19 and underscores the importance of continued research and development in this field.


title: Kalman filter based localization in hybrid BLE-UWB positioning system

abstract: In this paper a concept of hybrid Bluetooth Low Energy (BLE) Ultra-wideband (UWB) positioning system is presented. The system is intended to be energy efficient. Low energy BLE unit is used as a primary source of measurement data and for most of the time localization is calculated based on received signal strength (RSS). UWB technology is used less often. Time difference of arrival (TDOA) values measured with UWB radios are periodically used to improve RSS based localization. The paper contains a description of proposed hybrid positioning algorithm. Results of simulations and experiments confirming algorithm's efficiency are also included.


title: Thermodynamic formulation of vacuum energy density in flat spacetime and potential implications for the cosmological constant

abstract: We propose a thermodynamical definition of the vacuum energy density $\rho_{\rm vac}$, defined as $\langle 0| T_{\mu\nu} |0\rangle = - \rho_{\rm vac} \, g_{\mu\nu}$, in quantum field theory in flat Minkowski space in $D$ spacetime dimensions, which can be computed in the limit of high temperature, namely in the limit $\beta = 1/T \to 0$. It takes the form $\rho_{\rm vac} = {\rm const} \cdot m^D$ where $m$ is a fundamental mass scale and ${\rm "const"}$ is a computable constant which can be positive or negative. Due to modular invariance $\rho_{\rm vac}$ can also be computed in a different non-thermodynamic channel where one spatial dimension is compactifed on a circle of circumference $\beta$ and we confirm this modularity for free massive theories for both bosons and fermions for $D=2,3,4$. We list various properties of $\rho_{\rm vac}$ that are generally required, for instance $\rho_{\rm vac}=0$ for conformal field theories, and others, such as the constraint that $\rho_{\rm vac}$ has opposite signs for free bosons verses fermions of the same mass, which is related to constraints from supersymmetry. Using the Thermodynamic Bethe Ansatz we compute $\rho_{\rm vac}$ exactly for 2 classes of integrable QFT's in $2D$ and interpreting some previously known results. We apply our definition of $\rho_{\rm vac}$ to Lattice QCD data with two light quarks (up and down) and one additional massive flavor (the strange quark), and find it is negative, $\rho_{\rm vac} \approx - ( 200 \, {\rm MeV} )^4$. Finally we make some remarks on the Cosmological Constant Problem since $\rho_{\rm vac}$ is central to any discussion of it.


title: Concentration and central limit theorem for the averaging process on $\mathbb{Z}^{d}$

abstract: In the averaging process on a graph $G = (V, E)$, a random mass distribution $\eta$ on $V$ is repeatedly updated via transformations of the form $\eta_{v}, \eta_{w} \mapsto (\eta_{v} + \eta_{w})/2$, with updates made according to independent Poisson clocks associated to the edge set $E$. We study the averaging process when $G$ is the integer lattice $\mathbb{Z}^{d}$. We prove that the process has tight asymptotic concentration around its mean in the $\ell^{1}$ and $\ell^{2}$ norms and use this to prove a central limit theorem. Previous work by Nagahata and Yoshida implies the central limit theorem when $d \geq 3$. Our results extend this to hold for all $d \geq 1$, and our techniques are likely applicable to other processes for which previously only the $d \geq 3$ case was tractable.


title: A remark on omega limit sets for non-expansive dynamics

abstract: In this paper, we study systems of time-invariant ordinary differential equations whose flows are non-expansive with respect to a norm, meaning that the distance between solutions may not increase. Since non-expansiveness (and contractivity) are norm-dependent notions, the topology of $\omega$-limit sets of solutions may depend on the norm. For example, and at least for systems defined by real-analytic vector fields, the only possible $\omega$-limit sets of systems that are non-expansive with respect to polyhedral norms (such as $\ell^p$ norms with $p =1$ or $p=\infty$) are equilibria. In contrast, for non-expansive systems with respect to Euclidean ($\ell^2$) norm, other limit sets may arise (such as multi-dimensional tori): for example linear harmonic oscillators are non-expansive (and even isometric) flows, yet have periodic orbits as $\omega$-limit sets. This paper shows that the Euclidean linear case is what can be expected in general: for flows that are contractive with respect to any strictly convex norm (such as $\ell^p$ for any $p\not=1,\infty$), and if there is at least one bounded solution, then the $\omega$-limit set of every trajectory is also an omega limit set of a linear time-invariant system.


title: Semantic Augmentation in Images using Language

abstract: Deep Learning models are incredibly data-hungry and require very large labeled datasets for supervised learning. As a consequence, these models often suffer from overfitting, limiting their ability to generalize to real-world examples. Recent advancements in diffusion models have enabled the generation of photorealistic images based on textual inputs. Leveraging the substantial datasets used to train these diffusion models, we propose a technique to utilize generated images to augment existing datasets. This paper explores various strategies for effective data augmentation to improve the out-of-domain generalization capabilities of deep learning models.


title: A faster algorithm for the construction of optimal factoring automata

abstract: The problem of constructing optimal factoring automata arises in the context of unification factoring for the efficient execution of logic programs. Given an ordered set of $n$ strings of length $m$, the problem is to construct a trie-like tree structure of minimum size in which the leaves in left-to-right order represent the input strings in the given order. Contrary to standard tries, the order in which the characters of a string are encountered can be different on different root-to-leaf paths. Dawson et al. [ACM Trans. Program. Lang. Syst. 18(5):528--563, 1996] gave an algorithm that solves the problem in time $O(n^2 m (n+m))$. In this paper, we present an improved algorithm with running-time $O(n^2m)$.


title: Quasi-selfadjoint extensions of dual pairs of linear relations

abstract: This paper investigates quasi-selfadjoint extensions of dual pairs of linear relations in Hilbert spaces. Some properties of dual pairs of linear relations are given and an Hermitian linear relation associated with a dual pair of linear relations is introduced. Necessary and sufficient conditions for quasi-selfadjoint extensions of dual pairs of linear relations are obtained. These results extends the corresponding results for dual pairs of linear operators to dual pairs of linear relations.


title: Two Heads are Better than One: Nested PoE for Robust Defense Against Multi-Backdoors

abstract: Data poisoning backdoor attacks can cause undesirable behaviors in large language models (LLMs), and defending against them is of increasing importance. Existing defense mechanisms often assume that only one type of trigger is adopted by the attacker, while defending against multiple simultaneous and independent trigger types necessitates general defense frameworks and is relatively unexplored. In this paper, we propose Nested Product of Experts(NPoE) defense framework, which involves a mixture of experts (MoE) as a trigger-only ensemble within the PoE defense framework to simultaneously defend against multiple trigger types. During NPoE training, the main model is trained in an ensemble with a mixture of smaller expert models that learn the features of backdoor triggers. At inference time, only the main model is used. Experimental results on sentiment analysis, hate speech detection, and question classification tasks demonstrate that NPoE effectively defends against a variety of triggers both separately and in trigger mixtures. Due to the versatility of the MoE structure in NPoE, this framework can be further expanded to defend against other attack settings


title: NetSmith: An Optimization Framework for Machine-Discovered Network Topologies

abstract: Over the past few decades, network topology design for general purpose, shared memory multicores has been primarily driven by human experts who use their insights to arrive at network designs that balance the competing goals of performance requirements (e.g., latency, bandwidth) and cost constraints (e.g., router radix, router counts). On the other hand, there have been automatic NoC synthesis methods for SoCs to optimize for application-specific communication and objectives such as resource usage or power. Unfortunately, these techniques do not lend themselves to the general-purpose context, where directly applying these previous NoC synthesis techniques in the general-purpose context yields poor results, even worse than expert-designed networks. We design and develop an automatic network design methodology - NetSmith - to design networks for general-purpose, shared memory multicores that comprehensively outperform expert-designed networks. We employ NetSmith in the context of interposer networks for chiplet-based systems where there has been significant recent work on network topology design (e.g., Kite, Butter Donut, Double Butterfly). NetSmith generated topologies are capable of achieving significantly higher throughput (50% to 75% higher) while also reducing average hop count by 8% to 13.5%) than previous expert-designed and synthesized networks. Full system simulations using PARSEC benchmarks demonstrate that the improved network performance translates to improved application performance with up to 11% mean speedup over previous NoI topologies.


title: Solving the $KP$ problem with the Global Cartan Decomposition

abstract: Geometric methods have useful application for solving problems in a range of quantum information disciplines, including the synthesis of time-optimal unitaries in quantum control. In particular, the use of Cartan decompositions to solve problems in optimal control, especially lambda systems, has given rise to a range of techniques for solving the so-called $KP$-problem, where target unitaries belong to a semi-simple Lie group manifold $G$ whose Lie algebra admits a $\mathfrak{g}=\mathfrak{k} \oplus \mathfrak{p}$ decomposition and time-optimal solutions are represented by subRiemannian geodesics synthesised via a distribution of generators in $\mathfrak{p}$. In this paper, we propose a new method utilising global Cartan decompositions $G=KAK$ of symmetric spaces $G/K$ for generating time-optimal unitaries for targets $-iX \in [\frak{p},\frak{p}] \subset \frak{k}$ with controls $-iH(t) \in \frak{p}$. Target unitaries are parametrised as $U=kac$ where $k,c \in K$ and $a = e^{i\Theta}$ with $\Theta \in \frak{a}$. We show that the assumption of $d\Theta=0$ equates to the corresponding time-optimal unitary control problem being able to be solved analytically using variational techniques. We identify how such control problems correspond to the holonomies of a compact globally Riemannian symmetric space, where local translations are generated by $\mathfrak{p}$ and local rotations are generated by $[\mathfrak{p},\mathfrak{p}]$.


title: Attribution Regularization for Multimodal Paradigms

abstract: Multimodal machine learning has gained significant attention in recent years due to its potential for integrating information from multiple modalities to enhance learning and decision-making processes. However, it is commonly observed that unimodal models outperform multimodal models, despite the latter having access to richer information. Additionally, the influence of a single modality often dominates the decision-making process, resulting in suboptimal performance. This research project aims to address these challenges by proposing a novel regularization term that encourages multimodal models to effectively utilize information from all modalities when making decisions. The focus of this project lies in the video-audio domain, although the proposed regularization technique holds promise for broader applications in embodied AI research, where multiple modalities are involved. By leveraging this regularization term, the proposed approach aims to mitigate the issue of unimodal dominance and improve the performance of multimodal machine learning systems. Through extensive experimentation and evaluation, the effectiveness and generalizability of the proposed technique will be assessed. The findings of this research project have the potential to significantly contribute to the advancement of multimodal machine learning and facilitate its application in various domains, including multimedia analysis, human-computer interaction, and embodied AI research.


title: FraGNNet: A Deep Probabilistic Model for Mass Spectrum Prediction

abstract: The process of identifying a compound from its mass spectrum is a critical step in the analysis of complex mixtures. Typical solutions for the mass spectrum to compound (MS2C) problem involve matching the unknown spectrum against a library of known spectrum-molecule pairs, an approach that is limited by incomplete library coverage. Compound to mass spectrum (C2MS) models can improve retrieval rates by augmenting real libraries with predicted spectra. Unfortunately, many existing C2MS models suffer from problems with prediction resolution, scalability, or interpretability. We develop a new probabilistic method for C2MS prediction, FraGNNet, that can efficiently and accurately predict high-resolution spectra. FraGNNet uses a structured latent space to provide insight into the underlying processes that define the spectrum. Our model achieves state-of-the-art performance in terms of prediction error, and surpasses existing C2MS models as a tool for retrieval-based MS2C.


title: EnergAIze: Multi Agent Deep Deterministic Policy Gradient for Vehicle to Grid Energy Management

abstract: This paper investigates the increasing roles of Renewable Energy Sources (RES) and Electric Vehicles (EVs). While indicating a new era of sustainable energy, these also introduce complex challenges, including the need to balance supply and demand and smooth peak consumptions amidst rising EV adoption rates. Addressing these challenges requires innovative solutions such as Demand Response (DR), energy flexibility management, Renewable Energy Communities (RECs), and more specifically for EVs, Vehicle-to-Grid (V2G). However, existing V2G approaches often fall short in real-world adaptability, global REC optimization with other flexible assets, scalability, and user engagement. To bridge this gap, this paper introduces EnergAIze, a Multi-Agent Reinforcement Learning (MARL) energy management framework, leveraging the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm. EnergAIze enables user-centric and multi-objective energy management by allowing each prosumer to select from a range of personal management objectives, thus encouraging engagement. Additionally, it architects' data protection and ownership through decentralized computing, where each prosumer can situate an energy management optimization node directly at their own dwelling. The local node not only manages local energy assets but also fosters REC wide optimization. The efficacy of EnergAIze was evaluated through case studies employing the CityLearn simulation framework. These simulations were instrumental in demonstrating EnergAIze's adeptness at implementing V2G technology within a REC and other energy assets. The results show reduction in peak loads, ramping, carbon emissions, and electricity costs at the REC level while optimizing for individual prosumers objectives.


title: Task-priority Intermediated Hierarchical Distributed Policies: Reinforcement Learning of Adaptive Multi-robot Cooperative Transport

abstract: Multi-robot cooperative transport is crucial in logistics, housekeeping, and disaster response. However, it poses significant challenges in environments where objects of various weights are mixed and the number of robots and objects varies. This paper presents Task-priority Intermediated Hierarchical Distributed Policies (TIHDP), a multi-agent Reinforcement Learning (RL) framework that addresses these challenges through a hierarchical policy structure. TIHDP consists of three layers: task allocation policy (higher layer), dynamic task priority (intermediate layer), and robot control policy (lower layer). Whereas the dynamic task priority layer can manipulate the priority of any object to be transported by receiving global object information and communicating with other robots, the task allocation and robot control policies are restricted by local observations/actions so that they are not affected by changes in the number of objects and robots. Through simulations and real-robot demonstrations, TIHDP shows promising adaptability and performance of the learned multi-robot cooperative transport, even in environments with varying numbers of robots and objects. Video is available at https://youtu.be/Rmhv5ovj0xM


title: A comprehensive X-ray analysis of the massive O-type binary HD93250 over two decades

abstract: Massive star winds are known to be responsible for X-ray emission arising from wind plasma heated by the strong shocks up to the temperature of 10$^6$--10$^7$ K in case of colliding wind binaries. We have investigated thermal and non-thermal X-ray emission from the massive O-type star HD93250 to unveil its binary orbital parameters independently. To meet our goal, X-ray data obtained with XMM-Newton has been analyzed, spanning over $\sim$19 years. Additionally, we analyzed NuSTAR observations of HD93250 taken at various epochs. We determined the variability time-scale of the X-ray emission to be 193.8$\pm$1.3\,d, in full agreement with the 194.3$\pm$0.4\,d period derived from the astrometric orbit. The X-ray spectrum of HD93250 is well explained by a three-temperature thermal plasma emission model with temperatures of 0.26, 1.0, and 3.3 keV. The resulting X-ray flux varies in compliance with the typical colliding wind emission from eccentric massive binaries where it enhances near periastron passage and decreases gradually close to apastron, proportionally with the inverse of the binary separation. The periastron-to-apastron X-ray emission ratio points to an eccentricity range of 0.20-0.25, once again in agreement with the previously determined astrometric orbit. Finally, we did not detect any hard X-ray emission attributable to non-thermal emission above 10 keV. Given the derived plasma temperature, the strong phase-locked variability and the significant over-luminosity in X-rays, we establish that the X-ray emission from HD93250 is dominated by the colliding-wind region. Our results lend support to the idea that X-ray time analysis of massive stars constitutes a relevant tool to investigate their multiplicity and extract relevant information on their basic orbital parameters, such as the period and the eccentricity, independently of any orbital solution derived from usual techniques.


title: Learning Intersections of Halfspaces with Distribution Shift: Improved Algorithms and SQ Lower Bounds

abstract: Recent work of Klivans, Stavropoulos, and Vasilyan initiated the study of testable learning with distribution shift (TDS learning), where a learner is given labeled samples from training distribution $\mathcal{D}$, unlabeled samples from test distribution $\mathcal{D}'$, and the goal is to output a classifier with low error on $\mathcal{D}'$ whenever the training samples pass a corresponding test. Their model deviates from all prior work in that no assumptions are made on $\mathcal{D}'$. Instead, the test must accept (with high probability) when the marginals of the training and test distributions are equal. Here we focus on the fundamental case of intersections of halfspaces with respect to Gaussian training distributions and prove a variety of new upper bounds including a $2^{(k/\epsilon)^{O(1)}} \mathsf{poly}(d)$-time algorithm for TDS learning intersections of $k$ homogeneous halfspaces to accuracy $\epsilon$ (prior work achieved $d^{(k/\epsilon)^{O(1)}}$). We work under the mild assumption that the Gaussian training distribution contains at least an $\epsilon$ fraction of both positive and negative examples ($\epsilon$-balanced). We also prove the first set of SQ lower-bounds for any TDS learning problem and show (1) the $\epsilon$-balanced assumption is necessary for $\mathsf{poly}(d,1/\epsilon)$-time TDS learning for a single halfspace and (2) a $d^{\tilde{\Omega}(\log 1/\epsilon)}$ lower bound for the intersection of two general halfspaces, even with the $\epsilon$-balanced assumption. Our techniques significantly expand the toolkit for TDS learning. We use dimension reduction and coverings to give efficient algorithms for computing a localized version of discrepancy distance, a key metric from the domain adaptation literature.


title: Generalized Grothendieck's simultaneous resolution and associated varieties of simple affine vertex algebras

abstract: The closure of a Diximier sheet is the image of a generalized Grothendieck's simultaneous resolution. We show that the associated variety of simple affine vertex algebras is contained in the closure of the Diximier sheet when a chiralization of generalized Grothendieck's simultaneous resolution exists. This generalizes in a conceptual manner the results obtained by the first named author and Anne Moreau and, in particular, allows to extend them to the types A_2, C_n, E_6, E_7.


title: The modified Korteweg--de Vries limit of the Ablowitz--Ladik system

abstract: For slowly-varying initial data, solutions to the Ablowitz-Ladik system have been proven to converge to solutions of the cubic Schr\"odinger equation. In this paper we show that in the continuum limit, solutions to the Ablowitz-Ladik system with $H^1$ initial data may also converge to solutions of the modified Korteweg--de Vries equation. To exhibit this new limiting behavior, it suffices that the initial data is supported near the inflection points of the dispersion relation associated with the Ablowitz-Ladik system. Our arguments employ harmonic analysis tools, Strichartz estimates, and the conservation of mass and energy. Correspondingly, they are applicable beyond the completely integrable models of greatest interest to us.


title: A note on the exact formulas for certain $2$-color partitions

abstract: Let $p\leq 23$ be a prime and $a_p(n)$ counts the number of partitions of $n$ where parts that are multiple of $p$ come up with $2$ colors. Using a result of Sussman, we derive the exact formula for $a_p(n)$ and obtain an asymptotic formula for $\log a_p(n)$. Our results partially extend the work of Mauth, who proved the asymptotic formula for $\log a_2(n)$ conjectured by Banerjee et al.


title: Astrophotonics: recent and future developments

abstract: Astrophotonics is a burgeoning field that lies at the interface of photonics and modern astronomical instrumentation. Here we provide a pedagogical review of basic photonic functions that enable modern instruments, and give an overview of recent and future applications. Traditionally, optical fibres have been used in innovative ways to vastly increase the multiplex advantage of an astronomical instrument, e.g. the ability to observe hundreds or thousands of stars simultaneously. But modern instruments are using many new photonic functions, some emerging from the telecom industry, and others specific to the demands of adaptive optics systems on modern telescopes. As telescopes continue to increase in size, we look to a future where instruments exploit the properties of individual photons. In particular, we envisage telescopes and interferometers that build on international developments in quantum networks, the so-called quantum internet. With the aid of entangled photons and quantum logic gates, the new infrastructures seek to preserve the photonic state and timing of individual photons over a coherent network.


title: Grid-drawings of graphs in three-dimensions

abstract: Using probabilistic methods, we obtain grid-drawings of graphs without crossings with low volume and small aspect ratio. We show that every $D$-degenerate graph on $n$ vertices can be drawn in $[m]^3$ where $m^3 = O(D^2 n\log n)$. In particular, every graph of bounded maximum degree can be drawn in a grid with volume $O(n \log n)$.


title: Enhancing Human-Computer Interaction in Chest X-ray Analysis using Vision and Language Model with Eye Gaze Patterns

abstract: Recent advancements in Computer Assisted Diagnosis have shown promising performance in medical imaging tasks, particularly in chest X-ray analysis. However, the interaction between these models and radiologists has been primarily limited to input images. This work proposes a novel approach to enhance human-computer interaction in chest X-ray analysis using Vision-Language Models (VLMs) enhanced with radiologists' attention by incorporating eye gaze data alongside textual prompts. Our approach leverages heatmaps generated from eye gaze data, overlaying them onto medical images to highlight areas of intense radiologist's focus during chest X-ray evaluation. We evaluate this methodology in tasks such as visual question answering, chest X-ray report automation, error detection, and differential diagnosis. Our results demonstrate the inclusion of eye gaze information significantly enhances the accuracy of chest X-ray analysis. Also, the impact of eye gaze on fine-tuning was confirmed as it outperformed other medical VLMs in all tasks except visual question answering. This work marks the potential of leveraging both the VLM's capabilities and the radiologist's domain knowledge to improve the capabilities of AI models in medical imaging, paving a novel way for Computer Assisted Diagnosis with a human-centred AI.


title: Piecewise Contractions

abstract: We study piecewise injective, but not necessarily globally injective, contracting maps on a compact subset of \(\bR^d\). We prove that generically the attractor and the set of discontinuities are disjoint, and hence the attractor consists of periodic orbits. In addition, we prove that piecewise injective contractions are generically topologically stable.


title: Obfuscated Malware Detection: Investigating Real-world Scenarios through Memory Analysis

abstract: In the era of the internet and smart devices, the detection of malware has become crucial for system security. Malware authors increasingly employ obfuscation techniques to evade advanced security solutions, making it challenging to detect and eliminate threats. Obfuscated malware, adept at hiding itself, poses a significant risk to various platforms, including computers, mobile devices, and IoT devices. Conventional methods like heuristic-based or signature-based systems struggle against this type of malware, as it leaves no discernible traces on the system. In this research, we propose a simple and cost-effective obfuscated malware detection system through memory dump analysis, utilizing diverse machine-learning algorithms. The study focuses on the CIC-MalMem-2022 dataset, designed to simulate real-world scenarios and assess memory-based obfuscated malware detection. We evaluate the effectiveness of machine learning algorithms, such as decision trees, ensemble methods, and neural networks, in detecting obfuscated malware within memory dumps. Our analysis spans multiple malware categories, providing insights into algorithmic strengths and limitations. By offering a comprehensive assessment of machine learning algorithms for obfuscated malware detection through memory analysis, this paper contributes to ongoing efforts to enhance cybersecurity and fortify digital ecosystems against evolving and sophisticated malware threats. The source code is made open-access for reproducibility and future research endeavours. It can be accessed at https://bit.ly/MalMemCode.


title: Size-Mass Relations for Simulated Low-Mass Galaxies: Mock Imaging versus Intrinsic Properties

abstract: The observationally-inferred size versus stellar-mass relationship (SMR) for low-mass galaxies provides an important test for galaxy formation models. However, the relationship relies on assumptions that relate observed luminosity profiles to underlying stellar mass profiles. Here we use the Feedback in Realistic Environments simulations of low-mass galaxies to explore how the predicted SMR changes depending on whether one uses star-particle counts directly or mock observations. We reproduce the SMR found in The Exploration of Local Volume Satellites survey remarkably well only when we infer stellar masses and sizes using mock observations. However, when we use star particles to directly infer stellar masses and half-mass radii, we find that our galaxies are too large and obey a SMR with too little scatter compared to observations. This discrepancy between the "true" galaxy size and mass and those derived in the mock observation approach is twofold. First, our simulated galaxies have higher and more varied MLRs at a fixed colour than those commonly-adopted, which tends to underestimate their stellar masses compared to their true, simulated values. Second, our galaxies have radially increasing MLR gradients therefore using a single MLR tends to under-predict the mass in the outer regions. Similarly, the true half-mass radius is larger than the half-light radius because the light is more concentrated than the mass. If our simulations are accurate representations of the real universe, then the relationship between galaxy size and stellar mass is even tighter for low-mass galaxies than is commonly inferred from observed relations.


title: Detection and Mitigation of Cyberattacks on Volt-Var Control

abstract: Cyberattacks are becoming more frequent, and attackers can use different mechanisms, such as denial of service (DoS) and false data injection (FDI). Furthermore, multiple attack types can be launched simultaneously, known as hybrid attacks, to cause more damage. Volt-Var control algorithms are widely used in the distribution system to maintain the voltage within a nominal range. This work uses an artificial neural network (ANN)-based method to detect and mitigate hybrid cyberattacks on the Volt-VAr control algorithm.


title: Optical Text Recognition in Nepali and Bengali: A Transformer-based Approach

abstract: Efforts on the research and development of OCR systems for Low-Resource Languages are relatively new. Low-resource languages have little training data available for training Machine Translation systems or other systems. Even though a vast amount of text has been digitized and made available on the internet the text is still in PDF and Image format, which are not instantly accessible. This paper discusses text recognition for two scripts: Bengali and Nepali; there are about 300 and 40 million Bengali and Nepali speakers respectively. In this study, using encoder-decoder transformers, a model was developed, and its efficacy was assessed using a collection of optical text images, both handwritten and printed. The results signify that the suggested technique corresponds with current approaches and achieves high precision in recognizing text in Bengali and Nepali. This study can pave the way for the advanced and accessible study of linguistics in South East Asia.


title: Efficient ultra-broadband low-resolution astrophotonic spectrographs

abstract: Broadband low-resolution near-infrared spectrographs in a compact form are crucial for ground- and space-based astronomy and other fields of sensing. Astronomical spectroscopy poses stringent requirements including high efficiency, broad band operation ($>$ 300 nm), and in some cases, polarization insensitivity. We present and compare experimental results from the design, fabrication, and characterization of broadband (1200 - 1650 nm) arrayed waveguide grating (AWG) spectrographs built using the two most promising low-loss platforms - Si$_3$N$_4$ (rectangular waveguides) and doped-SiO$_2$ (square waveguides). These AWGs have a resolving power ($\lambda/\Delta\lambda$) of ~200, a free spectral range of ~ 200-350 nm, and a small footprint of ~ 50-100 mm$^2$. The peak overall (fiber-chip-fiber) efficiency of the doped-SiO$_2$ AWG was ~ 79\% (1 dB), and it exhibited a negligible polarization-dependent shift compared to the channel spacing. For Si$_3$N$_4$ AWGs, the peak overall efficiency in TE mode was ~ 50\% (3 dB), and the main loss component was found to be fiber-to-chip coupling losses. These broadband AWGs are key to enabling compact integrations such as multi-object spectrographs or dispersion back-ends for other astrophotonic devices such as photonic lanterns or nulling interferometers.


title: Exploring the Impact of Source Code Linearity on the Programmers Comprehension of API Code Examples

abstract: Context: Application Programming Interface (API) code examples are an essential knowledge resource for learning APIs. However, a few user studies have explored how the structural characteristics of the source code in code examples impact their comprehensibility and reusability. Objectives: We investigated whether the (a) linearity and (b) length of the source code in API code examples affect users performance in terms of correctness and time spent. We also collected subjective ratings. Methods: We conducted an online controlled code comprehension experiment with 61 Java developers. As a case study, we used the API code examples from the Joda-Time Java library. We had participants perform code comprehension and reuse tasks on variants of the example with different lengths and degrees of linearity. Findings: Participants demonstrated faster reaction times when exposed to linear code examples. However, no substantial differences in correctness or subjective ratings were observed. Implications: Our findings suggest that the linear presentation of a source code may enhance initial example understanding and reusability. This, in turn, may provide API developers with some insights into the effective structuring of their API code examples. However, we highlight the need for further investigation.


title: Faster Convergence of Stochastic Accelerated Gradient Descent under Interpolation

abstract: We prove new convergence rates for a generalized version of stochastic Nesterov acceleration under interpolation conditions. Unlike previous analyses, our approach accelerates any stochastic gradient method which makes sufficient progress in expectation. The proof, which proceeds using the estimating sequences framework, applies to both convex and strongly convex functions and is easily specialized to accelerated SGD under the strong growth condition. In this special case, our analysis reduces the dependence on the strong growth constant from $\rho$ to $\sqrt{\rho}$ as compared to prior work. This improvement is comparable to a square-root of the condition number in the worst case and address criticism that guarantees for stochastic acceleration could be worse than those for SGD.


title: Diamond principles and Tukey-top ultrafilters on a countable set

abstract: We provide two types of guessing principles for ultrafilter ($\diamondsuit^{-}_{\lambda}(U), \ \diamondsuit^p_\lambda(U)$) on $\omega$ which form subclasses of Tukey-top ultrafilters, and construct such ultrafilters in $ZFC$. These constructions are essentially different from Isbell's construction \cite{Isbell65} of Tukey-top ultrafilters. We prove using the Borel-Cantelli Lemma that full guessing is not possible and rule out several stronger guessing principles e.g. we prove that no Dodd-sound ultrafilters exist on $\omega$. We then apply these guessing principles to force a $q$-point which is Tukey-top (answering a question from \cite{Benhanou/Dobrinen23}), and prove that the class of ultrafilters which satisfy $\neg\diamondsuit^{-}_\lambda$ is closed under Fubini sum. Finally, we show that $\diamondsuit^{-}_\lambda$ and $\diamondsuit^p_\lambda$ can be separated.


title: A spectral investigation of criticality and crossover effects in two and three dimensions: Short timescales with small systems in minute random matrices

abstract: Random matrix theory, particularly using matrices akin to the Wishart ensemble, has proven successful in elucidating the thermodynamic characteristics of critical behavior in spin systems across varying interaction ranges. This paper explores the applicability of such methods in investigating critical phenomena and the crossover to tricritical points within the Blume-Capel model. Through an analysis of eigenvalue mean, dispersion, and extrema statistics, we demonstrate the efficacy of these spectral techniques in characterizing critical points in both two and three dimensions. Crucially, we propose a significant modification to this spectral approach, which emerges as a versatile tool for studying critical phenomena. Unlike traditional methods that eschew diagonalization, our method excels in handling short timescales and small system sizes, widening the scope of inquiry into critical behavior.


title: Balian-Bloch Wave Invariants for Nearly Degenerate Orbits

abstract: This paper is part I of a series in which we aim to show that the singular support of the wave trace and the length spectrum of a smooth, strictly convex, and bounded planar billiard table are generally distinct objects. We derive an asymptotic trace formula for the regularized resolvent which is dual to the wave trace and contains the same information. To do this, we consider a class of periodic orbits which have nearly degenerate Poincar\'e maps and study their leading order behavior as the deformation parameter goes to zero, generating large coefficients in the wave trace. We also keep careful track of the Maslov indices, which will allow us to match contributions of opposite signs in our subsequent paper. Each cancellation of coefficients in the resolvent trace corresponds to making the wave trace one degree smoother. The resolvent based approach is due to Balian and Bloch and was significantly expanded upon by Zelditch in a foundational series of papers [Zel09], [Zel04a], [Zel04c] and [Zel00].


title: Imaging transformer for MRI denoising with the SNR unit training: enabling generalization across field-strengths, imaging contrasts, and anatomy

abstract: The ability to recover MRI signal from noise is key to achieve fast acquisition, accurate quantification, and high image quality. Past work has shown convolutional neural networks can be used with abundant and paired low and high-SNR images for training. However, for applications where high-SNR data is difficult to produce at scale (e.g. with aggressive acceleration, high resolution, or low field strength), training a new denoising network using a large quantity of high-SNR images can be infeasible. In this study, we overcome this limitation by improving the generalization of denoising models, enabling application to many settings beyond what appears in the training data. Specifically, we a) develop a training scheme that uses complex MRIs reconstructed in the SNR units (i.e., the images have a fixed noise level, SNR unit training) and augments images with realistic noise based on coil g-factor, and b) develop a novel imaging transformer (imformer) to handle 2D, 2D+T, and 3D MRIs in one model architecture. Through empirical evaluation, we show this combination improves performance compared to CNN models and improves generalization, enabling a denoising model to be used across field-strengths, image contrasts, and anatomy.


title: Performance Analysis and ISI Mitigation with Imperfect Transmitter in Molecular Communication

abstract: In molecular communication (MC), molecules are released from the transmitter to convey information. This paper considers a realistic molecule shift keying (MoSK) scenario with two species of molecule in two reservoirs, where the molecules are harvested from the environment and placed into different reservoirs, which are purified by exchanging molecules between the reservoirs. This process consumes energy, and for a reasonable energy cost, the reservoirs cannot be pure; thus, our MoSK transmitter is imperfect, releasing mixtures of both molecules for every symbol, resulting in inter-symbol interference (ISI). To mitigate ISI, the properties of the receiver are analyzed and a detection method based on the ratio of different molecules is proposed. Theoretical and simulation results are provided, showing that with the increase of energy cost, the system achieves better performance. The good performance of the proposed detection scheme is also demonstrated.


title: Inline AI: Open-source Deep Learning Inference for Cardiac MR

abstract: Cardiac Magnetic Resonance (CMR) is established as a non-invasive imaging technique for evaluation of heart function, anatomy, and myocardial tissue characterization. Quantitative biomarkers are central for diagnosis and management of heart disease. Deep learning (DL) is playing an ever more important role in extracting these quantitative measures from CMR images. While many researchers have reported promising results in training and evaluating models, model deployment into the imaging workflow is less explored. A new imaging AI framework, the InlineAI, was developed and open-sourced. The main innovation is to enable the model inference inline as a part of imaging computation, instead of as an offline post-processing step and to allow users to plug in their models. We demonstrate the system capability on three applications: long-axis CMR cine landmark detection, short-axis CMR cine analysis of function and anatomy, and quantitative perfusion mapping. The InlineAI allowed models to be deployed into imaging workflow in a streaming manner directly on the scanner. The model was loaded and inference on incoming images were performed while the data acquisition was ongoing, and results were sent back to scanner. Several biomarkers were extracted from model outputs in the demonstrated applications and reported as curves and tabular values. All processes are full automated. the model inference was completed within 6-45s after the end of imaging data acquisition.


title: Entropy production and efficiency enhancement in quantum Otto engines operating at negative temperatures

abstract: Cyclic classical and quantum thermal machines show higher efficiency when the strokes are carried out quasi-statically. Recent theoretical and experimental work on figures of merit for thermal machines show that they have an advantage when operating in environments with negative temperatures. In an experimental proof of concept [Phys. Rev. Lett. 122, 240602 (2019)], it was shown that quantum Otto engines operating at negative temperatures can exhibit a behavior in which the faster the cycle is carried out, the higher the efficiency. In this work, we make use of the concept of entropy production and friction work to explain this counterintuitive behavior, and we show that it only occurs when reservoirs have negative temperatures.


title: Exact solution to Maxwell's equations for the infinite ideal solenoid with a time-dependent surface current

abstract: Very little previous literature has considered the *exact* solution to Maxwell's equations for an infinite ideal cylindrical solenoid with an arbitrary time-dependent azimuthal surface current $K(t) \hat{\bf \phi}$. Most of the previous literature has focused on special cases and has approached the problem by calculating the magnetic vector potential ${\bf A}$, which requires performing some very complicated surface integrals over the cylinder. In this article, we take a simpler approach and directly tackle Maxwell's equations without ever invoking a vector potential. The high symmetry of the geometry allows us to reduce Maxwell's equations to just two coupled partial differential equations for two functions of two real variables, which can be readily solved numerically. We find the general analytic solution to these PDEs and derive the Green's functions for the electromagnetic fields, which allow us to calculate the fields directly from the surface current $K(t)$. We also briefly discuss a family of exact formal solutions that (the author believes) has not appeared in the previous literature because it corresponds to a current $K(t)$ that does not have a Fourier transform.


title: An inversion problem for optical spectrum data via physics-guided machine learning

abstract: We propose the regularized recurrent inference machine (rRIM), a novel machine-learning approach to solve the challenging problem of deriving the pairing glue function from measured optical spectra. The rRIM incorporates physical principles into both training and inference and affords noise robustness, flexibility with out-of-distribution data, and reduced data requirements. It effectively obtains reliable pairing glue functions from experimental optical spectra and yields promising solutions for similar inverse problems of the Fredholm integral equation of the first kind.

categories: physics.data-an cond-mat.str-el cs.LG physics.comp-ph


title: CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation

abstract: Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability. Class activation maps (CAMs) and recent variants provide ways to visually explain the DNN decision-making process by displaying 'attention' heatmaps of the DNNs. Nevertheless, the CAM explanation only offers relative attention information, that is, on an attention heatmap, we can interpret which image region is more or less important than the others. However, these regions cannot be meaningfully compared across classes, and the contribution of each region to the model's class prediction is not revealed. To address these challenges that ultimately lead to better DNN Interpretation, in this paper, we propose CAPE, a novel reformulation of CAM that provides a unified and probabilistically meaningful assessment of the contributions of image regions. We quantitatively and qualitatively compare CAPE with state-of-the-art CAM methods on CUB and ImageNet benchmark datasets to demonstrate enhanced interpretability. We also test on a cytology imaging dataset depicting a challenging Chronic Myelomonocytic Leukemia (CMML) diagnosis problem. Code is available at: https://github.com/AIML-MED/CAPE.


title: On Linearizing Structured Data in Encoder-Decoder Language Models: Insights from Text-to-SQL

abstract: Structured data, prevalent in tables, databases, and knowledge graphs, poses a significant challenge in its representation. With the advent of large language models (LLMs), there has been a shift towards linearization-based methods, which process structured data as sequential token streams, diverging from approaches that explicitly model structure, often as a graph. Crucially, there remains a gap in our understanding of how these linearization-based methods handle structured data, which is inherently non-linear. This work investigates the linear handling of structured data in encoder-decoder language models, specifically T5. Our findings reveal the model's ability to mimic human-designed processes such as schema linking and syntax prediction, indicating a deep, meaningful learning of structure beyond simple token sequencing. We also uncover insights into the model's internal mechanisms, including the ego-centric nature of structure node encodings and the potential for model compression due to modality fusion redundancy. Overall, this work sheds light on the inner workings of linearization-based methods and could potentially provide guidance for future research.


title: Locally homogeneous RCD spaces

abstract: The goal of this note is to demonstrate how existing results can be adapted to establish the following result: A locally metric measure homogeneous $\mathrm{RCD}(K,N)$ space is isometric to, after multiplying a positive constant to the reference measure, a smooth Riemannian manifold with the Riemannian volume measure.


title: APC2Mesh: Bridging the gap from occluded building fa\c{c}ades to full 3D models

abstract: The benefits of having digital twins of urban buildings are numerous. However, a major difficulty encountered in their creation from airborne LiDAR point clouds is the effective means of accurately reconstructing significant occlusions amidst point density variations and noise. To bridge the noise/sparsity/occlusion gap and generate high fidelity 3D building models, we propose APC2Mesh which integrates point completion into a 3D reconstruction pipeline, enabling the learning of dense geometrically accurate representation of buildings. Specifically, we leveraged complete points generated from occluded ones as input to a linearized skip attention-based deformation network for 3D mesh reconstruction. In our experiments, conducted on 3 different scenes, we demonstrate that: (1) APC2Mesh delivers comparatively superior results, indicating its efficacy in handling the challenges of occluded airborne building points of diverse styles and complexities. (2) The combination of point completion with typical deep learning-based 3D point cloud reconstruction methods offers a direct and effective solution for reconstructing significantly occluded airborne building points. As such, this neural integration holds promise for advancing the creation of digital twins for urban buildings with greater accuracy and fidelity.


title: Low-resource neural machine translation with morphological modeling

abstract: Morphological modeling in neural machine translation (NMT) is a promising approach to achieving open-vocabulary machine translation for morphologically-rich languages. However, existing methods such as sub-word tokenization and character-based models are limited to the surface forms of the words. In this work, we propose a framework-solution for modeling complex morphology in low-resource settings. A two-tier transformer architecture is chosen to encode morphological information at the inputs. At the target-side output, a multi-task multi-label training scheme coupled with a beam search-based decoder are found to improve machine translation performance. An attention augmentation scheme to the transformer model is proposed in a generic form to allow integration of pre-trained language models and also facilitate modeling of word order relationships between the source and target languages. Several data augmentation techniques are evaluated and shown to increase translation performance in low-resource settings. We evaluate our proposed solution on Kinyarwanda - English translation using public-domain parallel text. Our final models achieve competitive performance in relation to large multi-lingual models. We hope that our results will motivate more use of explicit morphological information and the proposed model and data augmentations in low-resource NMT.


title: Backdoor Attack on Multilingual Machine Translation

abstract: While multilingual machine translation (MNMT) systems hold substantial promise, they also have security vulnerabilities. Our research highlights that MNMT systems can be susceptible to a particularly devious style of backdoor attack, whereby an attacker injects poisoned data into a low-resource language pair to cause malicious translations in other languages, including high-resource languages. Our experimental results reveal that injecting less than 0.01% poisoned data into a low-resource language pair can achieve an average 20% attack success rate in attacking high-resource language pairs. This type of attack is of particular concern, given the larger attack surface of languages inherent to low-resource settings. Our aim is to bring attention to these vulnerabilities within MNMT systems with the hope of encouraging the community to address security concerns in machine translation, especially in the context of low-resource languages.


title: Cohort-Individual Cooperative Learning for Multimodal Cancer Survival Analysis

abstract: Recently, we have witnessed impressive achievements in cancer survival analysis by integrating multimodal data, e.g., pathology images and genomic profiles. However, the heterogeneity and high dimensionality of these modalities pose significant challenges for extracting discriminative representations while maintaining good generalization. In this paper, we propose a Cohort-individual Cooperative Learning (CCL) framework to advance cancer survival analysis by collaborating knowledge decomposition and cohort guidance. Specifically, first, we propose a Multimodal Knowledge Decomposition (MKD) module to explicitly decompose multimodal knowledge into four distinct components: redundancy, synergy and uniqueness of the two modalities. Such a comprehensive decomposition can enlighten the models to perceive easily overlooked yet important information, facilitating an effective multimodal fusion. Second, we propose a Cohort Guidance Modeling (CGM) to mitigate the risk of overfitting task-irrelevant information. It can promote a more comprehensive and robust understanding of the underlying multimodal data, while avoiding the pitfalls of overfitting and enhancing the generalization ability of the model. By cooperating the knowledge decomposition and cohort guidance methods, we develop a robust multimodal survival analysis model with enhanced discrimination and generalization abilities. Extensive experimental results on five cancer datasets demonstrate the effectiveness of our model in integrating multimodal data for survival analysis.


title: Optimal Batch Allocation for Wireless Federated Learning

abstract: Federated learning aims to construct a global model that fits the dataset distributed across local devices without direct access to private data, leveraging communication between a server and the local devices. In the context of a practical communication scheme, we study the completion time required to achieve a target performance. Specifically, we analyze the number of iterations required for federated learning to reach a specific optimality gap from a minimum global loss. Subsequently, we characterize the time required for each iteration under two fundamental multiple access schemes: time-division multiple access (TDMA) and random access (RA). We propose a step-wise batch allocation, demonstrated to be optimal for TDMA-based federated learning systems. Additionally, we show that the non-zero batch gap between devices provided by the proposed step-wise batch allocation significantly reduces the completion time for RA-based learning systems. Numerical evaluations validate these analytical results through real-data experiments, highlighting the remarkable potential for substantial completion time reduction.


title: Enhancing Diffusion-based Point Cloud Generation with Smoothness Constraint

abstract: Diffusion models have been popular for point cloud generation tasks. Existing works utilize the forward diffusion process to convert the original point distribution into a noise distribution and then learn the reverse diffusion process to recover the point distribution from the noise distribution. However, the reverse diffusion process can produce samples with non-smooth points on the surface because of the ignorance of the point cloud geometric properties. We propose alleviating the problem by incorporating the local smoothness constraint into the diffusion framework for point cloud generation. Experiments demonstrate the proposed model can generate realistic shapes and smoother point clouds, outperforming multiple state-of-the-art methods.


title: Net proton number cumulants from viscous hydro with equation of state including a critical end point

abstract: In the SMASH-CLVisc-hybrid framework, including SMASH for the initial conditions and the hadronic rescattering stage, and CLVisc for the quark gluon plasma (QGP) evolution, we investigate net baryon number fluctuations via considering the equation of state (EoS) with and without a critical end point (CEP) in the QCD phase transition. Specifically, two distinct QCD EoS are utilized: one with smooth crossover derived from NEOS and another with a critical end point sourced from the rPNJL model. Our results show that non-monotonic behavior of $\kappa\sigma^2$ is not observed above the collision energy $7.7 {\rm GeV}$, nor are there explicit differences between the EoS characterized by crossover and that by CEP. This could be attributed to the significant deviation of the freeze-out line from the location of CEP. It is also found that the pure SMASH result of $\kappa \sigma^2$ is positive and close to zero at 3 GeV, which is different from the negative value observed from STAR.


title: Factors Affecting Terahertz Emission from InGaN Quantum Wells under Ultrafast Excitation

abstract: InGaN quantum wells (QWs) grown on c-plane sapphire substrate experience strain due to the lattice mismatch. The strain generates a strong piezoelectric field in QWs that contributes to THz emission under ultrafast excitation. Physical parameters such as QW width, period number, and Indium concentration can affect the strength of the piezoelectric field and result in THz emission. Experimental parameters such as pump fluence, laser energy, excitation power, pump polarization angle, and incident angle can be tuned to further optimize the THz emission. This review summarizes the effects of physical and experimental parameters of THz emission on InGaN QWs. Comparison and relationship between photoluminescence properties and THz emission in QWs are given, which further explains the origin of THz emission in InGaN QWs.


title: Extended Wannier-Stark ladder and particle-pair Bloch oscillations in dimerized non-Hermitian systems

abstract: In the Hermitian regime, the Wannier-Stark ladder characterizes the eigenstates of an electron in a periodic potential with an applied static electric field. In this work, we extend this concept to the complex regime for a periodic non-Hermitian system under a linear potential. We show that although the energy levels can be complex, they are still equally spaced by a real Bloch frequency. This ensures single-particle Bloch oscillations with a damping (or growing) rate. The system can also support standard two-particle Bloch oscillations under certain conditions. We propose two types of dimerized non-Hermitian systems to demonstrate our results. In addition, we also propose a scheme to demonstrate the results of electron-pair dynamics in a single-particle 2D $\mathcal{PT}$-symmetric square lattice.


title: Improved Semi-Parametric Bounds for Tail Probability and Expected Loss: Theory and Applications

abstract: Many management decisions involve accumulated random realizations for which the expected value and variance are assumed to be known. We revisit the tail behavior of such quantities when individual realizations are independent, and we develop new sharper bounds on the tail probability and expected linear loss. The underlying distribution is semi-parametric in the sense that it remains unrestricted other than the assumed mean and variance. Our bounds complement well-established results in the literature, including those based on aggregation, which often fail to take full account of independence and use less elegant proofs. New insights include a proof that in the non-identical case, the distributions attaining the bounds have the equal range property, and that the impact of each random variable on the expected value of the sum can be isolated using an extension of the Korkine identity. We show that the new bounds %not only complement the extant results but also open up abundant practical applications, including improved pricing of product bundles, more precise option pricing, more efficient insurance design, and better inventory management. For example, we establish a new solution to the optimal bundling problem, yielding a 17\% uplift in per-bundle profits, and a new solution to the inventory problem, yielding a 5.6\% cost reduction for a model with 20 retailers.


title: Transformations and quadratic forms on Wiener spaces

abstract: Two-way relationships between transformations and quadratic forms on Wiener spaces are investigated with the help of change of variables formulas on Wiener spaces. Further the evaluation of Laplace transforms of quadratic forms via Riccati or linear second order ODEs will be shown.


title: Token Trails: Navigating Contextual Depths in Conversational AI with ChatLLM

abstract: Conversational modeling using Large Language Models (LLMs) requires a nuanced understanding of context to generate coherent and contextually relevant responses. In this paper, we present Token Trails, a novel approach that leverages token-type embeddings to navigate the intricate contextual nuances within conversations. Our framework utilizes token-type embeddings to distinguish between user utterances and bot responses, facilitating the generation of context-aware replies. Through comprehensive experimentation and evaluation, we demonstrate the effectiveness of Token Trails in improving conversational understanding and response generation, achieving state-of-the-art performance. Our results highlight the significance of contextual modeling in conversational AI and underscore the promising potential of Token Trails to advance the field, paving the way for more sophisticated and contextually aware chatbot interactions.


title: Benchmarking Large Language Models for Persian: A Preliminary Study Focusing on ChatGPT

abstract: This paper explores the efficacy of large language models (LLMs) for Persian. While ChatGPT and consequent LLMs have shown remarkable performance in English, their efficiency for more low-resource languages remains an open question. We present the first comprehensive benchmarking study of LLMs across diverse Persian language tasks. Our primary focus is on GPT-3.5-turbo, but we also include GPT-4 and OpenChat-3.5 to provide a more holistic evaluation. Our assessment encompasses a diverse set of tasks categorized into classic, reasoning, and knowledge-based domains. To enable a thorough comparison, we evaluate LLMs against existing task-specific fine-tuned models. Given the limited availability of Persian datasets for reasoning tasks, we introduce two new benchmarks: one based on elementary school math questions and another derived from the entrance exams for 7th and 10th grades. Our findings reveal that while LLMs, especially GPT-4, excel in tasks requiring reasoning abilities and a broad understanding of general knowledge, they often lag behind smaller pre-trained models fine-tuned specifically for particular tasks. Additionally, we observe improved performance when test sets are translated to English before inputting them into GPT-3.5. These results highlight the significant potential for enhancing LLM performance in the Persian language. This is particularly noteworthy due to the unique attributes of Persian, including its distinct alphabet and writing styles.


title: Effect of the Source toSubstrate Distance on Structural, Optoelectronic, and Thermoelectric Properties of Zinc Sulfide Thin Films

abstract: Zinc sulfide ZnS thin films with variable structural, optical, electrical, and thermoelectric properties were obtained by changing the source to substrate SSD distance in the physical vaporthermal coating PVTC system. The films crystallized into a zinc blede cubic structure with 111 preferred orientation.


title: TE-TAD: Towards Full End-to-End Temporal Action Detection via Time-Aligned Coordinate Expression

abstract: In this paper, we investigate that the normalized coordinate expression is a key factor as reliance on hand-crafted components in query-based detectors for temporal action detection (TAD). Despite significant advancements towards an end-to-end framework in object detection, query-based detectors have been limited in achieving full end-to-end modeling in TAD. To address this issue, we propose \modelname{}, a full end-to-end temporal action detection transformer that integrates time-aligned coordinate expression. We reformulate coordinate expression utilizing actual timeline values, ensuring length-invariant representations from the extremely diverse video duration environment. Furthermore, our proposed adaptive query selection dynamically adjusts the number of queries based on video length, providing a suitable solution for varying video durations compared to a fixed query set. Our approach not only simplifies the TAD process by eliminating the need for hand-crafted components but also significantly improves the performance of query-based detectors. Our TE-TAD outperforms the previous query-based detectors and achieves competitive performance compared to state-of-the-art methods on popular benchmark datasets. Code is available at: https://github.com/Dotori-HJ/TE-TAD


title: Exploring Backdoor Vulnerabilities of Chat Models

abstract: Recent researches have shown that Large Language Models (LLMs) are susceptible to a security threat known as Backdoor Attack. The backdoored model will behave well in normal cases but exhibit malicious behaviours on inputs inserted with a specific backdoor trigger. Current backdoor studies on LLMs predominantly focus on instruction-tuned LLMs, while neglecting another realistic scenario where LLMs are fine-tuned on multi-turn conversational data to be chat models. Chat models are extensively adopted across various real-world scenarios, thus the security of chat models deserves increasing attention. Unfortunately, we point out that the flexible multi-turn interaction format instead increases the flexibility of trigger designs and amplifies the vulnerability of chat models to backdoor attacks. In this work, we reveal and achieve a novel backdoor attacking method on chat models by distributing multiple trigger scenarios across user inputs in different rounds, and making the backdoor be triggered only when all trigger scenarios have appeared in the historical conversations. Experimental results demonstrate that our method can achieve high attack success rates (e.g., over 90% ASR on Vicuna-7B) while successfully maintaining the normal capabilities of chat models on providing helpful responses to benign user requests. Also, the backdoor can not be easily removed by the downstream re-alignment, highlighting the importance of continued research and attention to the security concerns of chat models. Warning: This paper may contain toxic content.


title: Decision Transformer as a Foundation Model for Partially Observable Continuous Control

abstract: Closed-loop control of nonlinear dynamical systems with partial-state observability demands expert knowledge of a diverse, less standardized set of theoretical tools. Moreover, it requires a delicate integration of controller and estimator designs to achieve the desired system behavior. To establish a general controller synthesis framework, we explore the Decision Transformer (DT) architecture. Specifically, we first frame the control task as predicting the current optimal action based on past observations, actions, and rewards, eliminating the need for a separate estimator design. Then, we leverage the pre-trained language models, i.e., the Generative Pre-trained Transformer (GPT) series, to initialize DT and subsequently train it for control tasks using low-rank adaptation (LoRA). Our comprehensive experiments across five distinct control tasks, ranging from maneuvering aerospace systems to controlling partial differential equations (PDEs), demonstrate DT's capability to capture the parameter-agnostic structures intrinsic to control tasks. DT exhibits remarkable zero-shot generalization abilities for completely new tasks and rapidly surpasses expert performance levels with a minimal amount of demonstration data. These findings highlight the potential of DT as a foundational controller for general control applications.


title: CMULAB: An Open-Source Framework for Training and Deployment of Natural Language Processing Models

abstract: Effectively using Natural Language Processing (NLP) tools in under-resourced languages requires a thorough understanding of the language itself, familiarity with the latest models and training methodologies, and technical expertise to deploy these models. This could present a significant obstacle for language community members and linguists to use NLP tools. This paper introduces the CMU Linguistic Annotation Backend, an open-source framework that simplifies model deployment and continuous human-in-the-loop fine-tuning of NLP models. CMULAB enables users to leverage the power of multilingual models to quickly adapt and extend existing tools for speech recognition, OCR, translation, and syntactic analysis to new languages, even with limited training data. We describe various tools and APIs that are currently available and how developers can easily add new models/functionality to the framework. Code is available at https://github.com/neulab/cmulab along with a live demo at https://cmulab.dev


title: Locally finite graphs and their localization numbers

abstract: We study the Localization game on locally finite graphs trees, where each of the countably many vertices have finite degree. In contrast to the finite case, we construct a locally finite tree with localization number $n$ for any choice of positive integer $n$. Our examples have uncountably many ends, and we show that this is necessary by proving that locally finite trees with finitely or countably many ends have localization number at most 2. Finally, as is the case for finite graphs, we prove that any locally finite graph contains a subdivision where one cop can capture the robber.


title: TCLC-GS: Tightly Coupled LiDAR-Camera Gaussian Splatting for Surrounding Autonomous Driving Scenes

abstract: Most 3D Gaussian Splatting (3D-GS) based methods for urban scenes initialize 3D Gaussians directly with 3D LiDAR points, which not only underutilizes LiDAR data capabilities but also overlooks the potential advantages of fusing LiDAR with camera data. In this paper, we design a novel tightly coupled LiDAR-Camera Gaussian Splatting (TCLC-GS) to fully leverage the combined strengths of both LiDAR and camera sensors, enabling rapid, high-quality 3D reconstruction and novel view RGB/depth synthesis. TCLC-GS designs a hybrid explicit (colorized 3D mesh) and implicit (hierarchical octree feature) 3D representation derived from LiDAR-camera data, to enrich the properties of 3D Gaussians for splatting. 3D Gaussian's properties are not only initialized in alignment with the 3D mesh which provides more completed 3D shape and color information, but are also endowed with broader contextual information through retrieved octree implicit features. During the Gaussian Splatting optimization process, the 3D mesh offers dense depth information as supervision, which enhances the training process by learning of a robust geometry. Comprehensive evaluations conducted on the Waymo Open Dataset and nuScenes Dataset validate our method's state-of-the-art (SOTA) performance. Utilizing a single NVIDIA RTX 3090 Ti, our method demonstrates fast training and achieves real-time RGB and depth rendering at 90 FPS in resolution of 1920x1280 (Waymo), and 120 FPS in resolution of 1600x900 (nuScenes) in urban scenarios.


title: A Unified Editing Method for Co-Speech Gesture Generation via Diffusion Inversion

abstract: Diffusion models have shown great success in generating high-quality co-speech gestures for interactive humanoid robots or digital avatars from noisy input with the speech audio or text as conditions. However, they rarely focus on providing rich editing capabilities for content creators other than high-level specialized measures like style conditioning. To resolve this, we propose a unified framework utilizing diffusion inversion that enables multi-level editing capabilities for co-speech gesture generation without re-training. The method takes advantage of two key capabilities of invertible diffusion models. The first is that through inversion, we can reconstruct the intermediate noise from gestures and regenerate new gestures from the noise. This can be used to obtain gestures with high-level similarities to the original gestures for different speech conditions. The second is that this reconstruction reduces activation caching requirements during gradient calculation, making the direct optimization on input noises possible on current hardware with limited memory. With different loss functions designed for, e.g., joint rotation or velocity, we can control various low-level details by automatically tweaking the input noises through optimization. Extensive experiments on multiple use cases show that this framework succeeds in unifying high-level and low-level co-speech gesture editing.


title: Quantitative Hydrodynamic Stability for Couette Flow on Unbounded Domains with Navier Boundary Conditions

abstract: We prove a stability threshold theorem for 2D Navier-Stokes on three unbounded domains: the whole plane $\mathbb{R} \times \mathbb{R}$, the half plane $\mathbb{R} \times [0,\infty)$ with Navier boundary conditions, and the infinite channel $\mathbb{R} \times [-1, 1]$ with Navier boundary conditions. Starting with the Couette shear flow, we consider initial perturbations $\omega_{in}$ which are of size $\nu^{1/2}(1+\ln(1/\nu)^{1/2})^{-1}$ in an anisotropic Sobolev space with an additional low frequency control condition for the planar cases. We then demonstrate that such perturbations exhibit inviscid damping of the velocity, as well as enhanced dissipation at $x$-frequencies $|k| \gg \nu$ with decay time-scale $O(\nu^{-1/3}|k|^{-2/3})$. On the plane and half-plane, we show Taylor dispersion for $x$-frequencies $|k| \ll \nu$ with decay time-scale $O(\nu |k|^{-2})$, while on the channel we show low frequency dispersion for $|k| \ll \nu$ with decay time-scale $O(\nu^{-1})$. Generalizing the work of arXiv:2311.00141 done on $\mathbb{T} \times [-1,1]$, the key contribution of this paper is to perform new nonlinear computations at low frequencies with wave number $|k| \lesssim \nu$ and at intermediate frequencies with wave number $\nu \lesssim |k| \leq 1$, and to provide the first enhanced dissipation result for a fully-nonlinear shear flow on an unbounded $x$-domain.


title: Generalization of Spivey's recurrence relation

abstract: In 2008, Spivey found a recurrence relation for the Bell numbers. We consider the probabilistic r-Bell polynomials associated with which are a probabilistic extension of the r-Bell polynomials. Here Y is a random variable whose moment generating function exists in some neighborhood of the origin . The aim of this paper is to generalize the relation for the Bell numbers to that for the probabilistic r-Bell polynomials associated with Y.


title: A simple lower bound for the complexity of estimating partition functions on a quantum computer

abstract: We study the complexity of estimating the partition function $\mathsf{Z}(\beta)=\sum_{x\in\chi} e^{-\beta H(x)}$ for a Gibbs distribution characterized by the Hamiltonian $H(x)$. We provide a simple and natural lower bound for quantum algorithms that solve this task by relying on reflections through the coherent encoding of Gibbs states. Our primary contribution is a $\varOmega(1/\epsilon)$ lower bound for the number of reflections needed to estimate the partition function with a quantum algorithm. The proof is based on a reduction from the problem of estimating the Hamming weight of an unknown binary string.


title: What Are We Measuring When We Evaluate Large Vision-Language Models? An Analysis of Latent Factors and Biases

abstract: Vision-language (VL) models, pretrained on colossal image-text datasets, have attained broad VL competence that is difficult to evaluate. A common belief is that a small number of VL skills underlie the variety of VL tests. In this paper, we perform a large-scale transfer learning experiment aimed at discovering latent VL skills from data. We reveal interesting characteristics that have important implications for test suite design. First, generation tasks suffer from a length bias, suggesting benchmarks should balance tasks with varying output lengths. Second, we demonstrate that factor analysis successfully identifies reasonable yet surprising VL skill factors, suggesting benchmarks could leverage similar analyses for task selection. Finally, we present a new dataset, OLIVE (https://github.com/jq-zh/olive-dataset), which simulates user instructions in the wild and presents challenges dissimilar to all datasets we tested. Our findings contribute to the design of balanced and broad-coverage vision-language evaluation methods.


title: Revealing kinetically tuned atomic pathways for interfacial strain relaxation

abstract: Strain at interfaces may profoundly impact the microstructure and properties of materials; thus, it is a major consideration when designing and engineering materials. Dislocation formation is a commonly known mechanism to release mismatch strain at solid-solid interfaces. However, it is still unclear about how materials accommodate interfacial strain under drastically accelerated structural transformation kinetics, since it is extremely challenging to directly observe the atomic structure evolution of fast-propagating interfaces. Utilizing liquid phase transmission electron microscopy (TEM), we have achieved atomic-scale imaging of hydrogen-induced phase transformations of palladium nanocrystals with different transformation speeds. Our observation reveals that the fast phase transformation occurs with an expanded interface of mixed $\alpha$- and $\beta$-$\mathrm{PdH}_x$ phases, and tilting of (020) planes to accommodate mismatch strain. In contrast, slow phase transformations lead to sharp interfaces with slipping misfit dislocations. Our kinetic Monte Carlo simulations show that fast phase transformation pushes the system far-from-equilibrium, generically roughening the interface; however, a smooth boundary minimizes strain near-equilibrium. Unveiling the atomic pathways of transformations from near-equilibrium to far-from-equilibrium, which was previously possible only computationally, this work holds significant implications for engineering microstructure of materials through modulating solid-solid transformations in a wide range of kinetics.


title: One-loop contributions for $A^0 \rightarrow \ell \bar{\ell} V$ with $\ell \equiv e, \mu$ and $V\equiv \gamma, Z$ in Higgs Extensions of the Standard Model

abstract: We present one-loop formulas for the decay of CP-odd Higgs $A^0 \rightarrow \ell \bar{\ell} V$ with $\ell \equiv e, \mu$ and $V\equiv \gamma, Z$ in Higgs Extensions of the Standard Model, considering two higgs doublet model with a complex (and real) scalar, two higgs doublet model as well as triplet higgs model. Analytic results for one-loop amplitudes are expressed in terms of Passarino-Veltman functions following the standard notations of {\tt LoopTools}. As a result, physical results can be generated numerically by using the package. In phenomenological results, the total decay widths and the differential decay rates with respect to the invariant mass of lepton pair are analyzed for two typical models such as two higgs doublet model and triplet higgs model.


title: Auxiliary task demands mask the capabilities of smaller language models

abstract: Developmental psychologists have argued about when cognitive capacities such as language understanding or theory of mind emerge. These debates often hinge on the concept of "task demands" -- the auxiliary challenges associated with performing a particular evaluation -- that may mask the child's underlying ability. The same issues arise when measuring the capacities of language models (LMs): performance on a task is a function of the model's underlying competence, combined with the model's ability to interpret and perform the task given its available resources. Here, we show that for analogical reasoning, reflective reasoning, word prediction, and grammaticality judgments, evaluation methods with greater task demands yield lower performance than evaluations with reduced demands. This "demand gap" is most pronounced for models with fewer parameters and less training data. Our results illustrate that LM performance should not be interpreted as a direct indication of intelligence (or lack thereof), but as a reflection of capacities seen through the lens of researchers' design choices.


title: The first CCD photometric studies of the member eclipsing binary ZTFJ015003.88+534734.1 in the newly discovered young open cluster UBC 188

abstract: We present the first CCD observations of an eclipsing binary, ZTFJ015003.88+534734.1, which is a member in the open star cluster UBC 188. The observations were taken by the 1.88 m telescope at the Kottamia Astronomical Observatory (KAO) in SDSS griz bands. The latest version of the Wilson- Devinney (W-D) code was employed for photometric analysis and light curve modeling of the eclipsing binary. The results indicate that the binary system is in an over-contact configuration. The mass of the primary star (M1) is determined to be 1.293 Msun, and the mass of the secondary star (M2) is directly derived from the system's estimated mass ratio (q= M2/M1) as 0.340 times the solar mass (Msun). We investigated the color-magnitude diagram and the membership probability of the open cluster UBC 188 using the Gaia DR3 data. We determined the membership probability of the eclipsing binary ZTFJ015003.88+534734.1 using the pyUPMASK algorithm and found that its membership probability is one.


title: High quality Fe1+yTe synthesized by chemical vapor deposition with conspicuous vortex flow

abstract: Two-dimensional (2D) materials provide an ideal platform to explore novel superconducting behavior including Ising superconductivity, topological superconductivity and Majorana bound states in different 2D stoichiometric Ta-, Nb-, and Fe-based crystals. However, tuning the element content in 2D compounds for regulating their superconductivity has not been realized. In this work, we report the synthesis of high quality Fe1+yTe with tunable Fe content by chemical vapor deposition (CVD). The quality and composition of Fe1+yTe are characterized by Raman spectroscopy, X-ray photoelectron spectroscopy (XPS) and scanning transmission electron microscopy (STEM). The superconducting behavior of Fe1+yTe crystals with varying Fe contents is observed. The superconducting transition of selected Fe1.13Te sample is sharp ({\Delta}Tc = 1 K), while Fe1.43Te with a high-Fe content shows a relative broad superconducting transition ({\Delta}Tc = 2.6 K) at zero magnetic field. Significantly, the conspicuous vortex flow and a transition from a 3D vortex liquid state to a 2D vortex liquid state is observed in Fe1.43Te sample. Our work highlights the tunability of the superconducting properties of Fe1+yTe and sheds light on the vortex dynamics in Fe-based superconductors, which facilitates us to understand the intrinsic mechanisms of high-temperature superconductivity.


title: Revisiting subword tokenization: A case study on affixal negation in large language models

abstract: In this work, we measure the impact of affixal negation on modern English large language models (LLMs). In affixal negation, the negated meaning is expressed through a negative morpheme, which is potentially challenging for LLMs as their tokenizers are often not morphologically plausible. We conduct extensive experiments using LLMs with different subword tokenization methods, which lead to several insights on the interaction between tokenization performance and negation sensitivity. Despite some interesting mismatches between tokenization accuracy and negation detection performance, we show that models can, on the whole, reliably recognize the meaning of affixal negation.


title: Enhancing Low-Resource LLMs Classification with PEFT and Synthetic Data

abstract: Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. In-Context Learning (ICL) typically achieves better accuracy than the 0-shot setting, but it pays in terms of efficiency, due to the longer input prompt. In this paper, we propose a strategy to make LLMs as efficient as 0-shot text classifiers, while getting comparable or better accuracy than ICL. Our solution targets the low resource setting, i.e., when only 4 examples per class are available. Using a single LLM and few-shot real data we perform a sequence of generation, filtering and Parameter-Efficient Fine-Tuning steps to create a robust and efficient classifier. Experimental results show that our approach leads to competitive results on multiple text classification datasets.


title: Radio Scrutiny of the X-ray-Weak Tail of Low-Mass Active Galactic Nuclei: A Novel Signature of High-Eddington Accretion?

abstract: The supermassive black holes ($M_{\rm BH} \sim 10^{6}$$-$$10^{10}~M_\odot$) that power luminous active galactic nuclei (AGNs), i.e., quasars, generally show a correlation between thermal disk emission in the ultraviolet (UV) and coronal emission in hard X-rays. In contrast, some "massive" black holes (mBHs; $M_{\rm BH} \sim 10^{5}$$-$$10^{6}~M_\odot$) in low-mass galaxies present curious X-ray properties with coronal radiative output up to 100$\times$ weaker than expected. To examine this issue, we present new and archival 10 GHz Very Large Array observations of a sample of high-accretion-rate (Eddington ratios $L_{\rm bol}/L_{\rm Edd} > 0.1$), mBH-powered AGNs with Chandra X-ray coverage. Empirical correlations previously revealed in samples of radio-quiet, high-Eddington AGNs indicate that the radio$-$X-ray luminosity ratio, $L_{\rm R}/L_{\rm X}$, is approximately constant. Through multiwavelength analysis, we instead find that the X-ray-weaker mBHs in our sample tend toward larger values of $L_{\rm R}/L_{\rm X}$ even though they remain radio-quiet per their optical$-$UV properties. This trend results in a tentative but highly intriguing correlation between $L_{\rm R}/L_{\rm X}$ and X-ray weakness, which we argue is consistent with a scenario in which X-rays may be preferentially obscured from our line of sight by a "slim" accretion disk. We compare this observation to weak emission-line quasars (AGNs with exceptionally weak broad-line emission and a significant X-ray-weak fraction) and conclude by suggesting that our results may offer a new observational signature for finding high-accretion-rate AGNs.