title: The High Energy X-ray Probe (HEX-P): Sensitive broadband X-ray observations of transient phenomena in the 2030s

abstract: HEX-P will launch at a time when the sky is being routinely scanned for transient gravitational wave, electromagnetic and neutrino phenomena that will require the capabilities of a sensitive, broadband X-ray telescope for follow up studies. These include the merger of compact objects such as neutron stars and black holes, stellar explosions, and the birth of new compact objects. \hexp\ will probe the accretion and ejecta from these transient phenomena through the study of relativistic outflows and reprocessed emission, provide unique capabilities for understanding jet physics, and potentially revealing the nature of the central engine.


title: Comparing Repeated Gravitational-Wave Bursts Emitted by Cosmic Strings

abstract: The principal energy loss mechanism in a Nambu-Goto cosmic string network involves loop production and the subsequent gravitational-wave emission. Recently, it has been shown that the loop oscillations produce repeated gravitational-wave bursts emitted at cusps. The calculations are extended to estimate the number of burst repeaters, including kink emissions and kink-kink collisions. Our findings indicate that despite the potentially large number of kinks, we anticipate observing a higher number of burst repeaters from cusps for both LIGO-Virgo-KAGRA and the Laser Interferometer Space Antenna. We also conduct calculations using the second main loop distribution model in the current literature. We find that this model predicts a notably higher number of repeaters, which provides a reason to include it in future data analysis. These results offer insights into the potential observability of different loop features for future detectors, such as the space-based laser interferometers Taiji and TianQin.


title: Scalable Fault-Tolerant Quantum Technologies with Silicon Colour Centres

abstract: The scaling barriers currently faced by both quantum networking and quantum computing technologies ultimately amount to the same core challenge of distributing high-quality entanglement at scale. In this Perspective, a novel quantum information processing architecture based on optically active spins in silicon is proposed that offers a combined single technological platform for scalable fault-tolerant quantum computing and networking. The architecture is optimized for overall entanglement distribution and leverages colour centre spins in silicon (T centres) for their manufacturability, photonic interface, and high fidelity information processing properties. Silicon nanophotonic optical circuits allow for photonic links between T centres, which are networked via telecom-band optical photons in a highly-connected graph. This high connectivity unlocks the use of low-overhead quantum error correction codes, significantly accelerating the timeline for modular, scalable fault-tolerant quantum repeaters and quantum processors.


title: Modeling of cosmic rays and near-IR photons in aluminum KIDs

abstract: The PRobe far-Infrared Mission for Astrophysics (PRIMA) is working to develop kinetic inductance detectors (KIDs) that can meet the sensitivity targets of a far-infrared spectrometer on a cryogenically cooled space telescope. An important ingredient for achieving high sensitivity is increasing the fractional-frequency responsivity. Here we present a study of the responsivity of aluminum KIDs fabricated at the Jet Propulsion Laboratory. Specifically, we model the KID's temporal response to pair-breaking excitations in the framework of the Mattis-Bardeen theory, incorporating quasiparticle recombination dynamics and the pair-breaking efficiency. Using a near-IR laser, we measure time-resolved photon pulses and fit them to our model, extracting the time-resolved quasiparticle density and the quasiparticle recombination lifetime. Comparing the fit to the known energy of the laser provides a measurement of the pair-breaking efficiency. In addition to photon-sourced excitations, it is important to understand the KID's response to phonon-sourced excitations from cosmic rays. We measure the rate of secondary cosmic rays detected by our devices, and predict the dead time due to cosmic rays for an array in L2 orbit. This work provides confidence in KIDs' robustness to cosmic ray events in the space environment.


title: An effective Linear Independence conjecture for the zeros of the Riemann zeta function and applications

abstract: Using the same heuristic argument leading to the Lang-Waldschmidt Conjecture in the theory of linear forms in logarithms, we formulate an effective version of the Linear Independence conjecture for the ordinates of the non-trivial zeros of the Riemann zeta function. Then assuming this conjecture, we obtain Omega results for the error term in the prime number theorem, which are conjectured to be best possible by Montgomery. This was claimed to appear in Monach's thesis by Montgomery and Vaughan in their classical book, but such a result or its proof is nowhere to be found in this thesis or in the litterature. Moreover, if in addition to this effective Linear Independence conjecture we assume a conjecture of Gonek and Hejhal on the negative moments of the derivative of the Riemann zeta function, we can show that the summatory function of the M\"obius function $M(x)$ is $\Omega_{\pm}\left(\sqrt{x}(\log\log\log x)^{5/4}\right)$. This conditionally resolves a part of a conjecture of Gonek.


title: Sandi: A System for Accountability and Applications in Direct Communication (Extended Abstract)

abstract: Reputation systems guide our decision making both in life and work: which restaurant to eat at, which vendor to buy from, which software dependencies to use, and who or what to trust. These systems are often based on old ideas and are failing in the face of modern threats. Fraudsters have found ways to manipulate them, undermining their integrity and utility. Generative AI adds to the problem by enabling the creation of real-looking fake narratives at scale, creating a false sense of consensus. Meanwhile, the need for reliable reputation concepts is more important than ever, as wrong decisions lead to increasingly severe outcomes: wasted time, poor service, and a feeling of injustice at best, fraud, identity theft, and ransomware at worst. In this extended abstract we introduce Sandi, a new kind of reputation system with a single well-defined purpose: to create trust through accountability in one-to-one transactions. Examples of such transactions include sending an email or making a purchase online. Sandi has strong security and privacy properties that make it suitable for use also in sensitive contexts. Furthermore, Sandi can guarantee reputation integrity and transparency for its registered users. As a primary application, we envision how Sandi could counter fraud and abuse in direct communication. Concretely, message senders request a cryptographic tag from Sandi that they send along with their message. If the receiver finds the message inappropriate, they can report the sender using this tag. Notably, only senders need registered accounts and do not need to manage long-term keys. The design of Sandi ensures compatibility with any communication system that allows for small binary data transmission.


title: A Possible Correlation between Metallicity and Near-IR Color for Late-M and L Dwarfs

abstract: We examine the relationship between metallicity and $J-K$ color for 64 benchmark late-M and L dwarfs, all of which are wide companions to higher mass stars, and 6 of which are new discoveries. We assess the correlation between the $\Delta(J-K)$ color anomaly (the difference of an object's $J-K$ color with the median color for field objects of the same spectral type) and the host star metallicity to investigate how metallicity affects ultracool photospheres. Using Spearman's rank correlation test and Student's t test, the late-M dwarf (L dwarf) sample's $\Delta(J-K)$ and metallicity show a positive correlation with 95\% (90\%) confidence level. A linear fit to color anomaly as a function of metallicity finds a slope of $0.17\pm0.07$ for the late-M dwarfs and a slope of $0.20^{+0.07}_{-0.08}$ for the L dwarfs. We also computed the $\Delta(J-K)$ versus metallicity relationship predicted by multi-metallicity model spectra generated using Drift-Phoenix. The modeled late-M dwarfs show a slope of 0.202$\pm$0.03, which is close to our observational results, but the modeled L dwarfs show a slope of 0.493$\pm$0.02, steeper than our observational results. Both our empirical results and the models indicate that more metal-rich objects should appear redder photometrically. We speculate that higher metallicity drives more condensate formation in these atmospheres, thus making these ultracool dwarfs appear redder.


title: Photometric prioritization of neutron star merger candidates

abstract: Rapid identification of the optical counterparts of Neutron Star (NS) merger events discovered by gravitational wave detectors may require observing a large error region and sifting through a large number of transients to identify the object of interest. Given the expense of spectroscopic observations, a question arises: How can we utilize photometric observations for candidate prioritization, and what kinds of photometric observations are needed to achieve this goal? NS merger kilonova exhibits low ejecta mass (~5x10^-2 solar mass) and a rapidly evolving photospheric radius (with a velocity ~0.2c). As a consequence, these sources display rapid optical-flux evolution. Indeed, selection based on fast flux variations is commonly used for young supernovae and NS mergers. In this study, we leverage the best currently available flux-limited transient survey - the Zwicky Transient Facility Bright Transient Survey - to extend and quantify this approach. We focus on selecting transients detected in a 3-day cadence survey and observed at a one-day cadence. We explore their distribution in the phase space defined by g-r, g-dot, and r-dot. Our analysis demonstrates that for a significant portion of the time during the first week, the kilonova AT 2017gfo stands out in this phase space. It is important to note that this investigation is subject to various biases and challenges; nevertheless, it suggests that certain photometric observations can be leveraged to identify transients with the highest probability of being fast-evolving events. We also find that a large fraction (~0.75) of the transient candidates with |g-dot|>0.7 mag/day, are cataclysmic variables or active galactic nuclei with radio counterparts.


title: Realization of programmable Ising models in a trapped-ion quantum simulator

abstract: A promising paradigm of quantum computing for achieving practical quantum advantages is quantum annealing or quantum approximate optimization algorithm, where the classical problems are encoded in Ising interactions. However, it is challenging to build a quantum system that can efficiently map any structured problems. Here, we present a programmable trapped-ion quantum simulator of an Ising model with all-to-all connectivity with up to four spins. We implement the spin-spin interactions by using the coupling of trapped ions to multiple collective motional modes and realize the programmability through phase modulation of the Raman laser beams that are individually addressed on ions. As an example, we realize several Ising lattices with different interaction connectivities, where the interactions can be ferromagnetic or anti-ferromagnetic. We confirm the programmed interaction geometry by observing the ground states of the corresponding models through quantum state tomography. Our experimental demonstrations serve as an important basis for realizing practical quantum advantages with trapped ions.


title: Computing the $5$-Edge-Connected Components in Linear Time

abstract: We provide a deterministic algorithm for computing the $5$-edge-connected components of an undirected multigraph in linear time. There were probably good indications that this computation can be performed in linear time, but no such algorithm was actually known prior to this work. Thus, our paper answers a theoretical question, and sheds light on the possibility that a solution may exist for general $k$. A key component in our algorithm is an oracle for answering connectivity queries for pairs of vertices in the presence of at most four edge-failures. Specifically, the oracle has size $O(n)$, it can be constructed in linear time, and it answers connectivity queries in the presence of at most four edge-failures in worst-case constant time, where $n$ denotes the number of vertices of the graph. We note that this is a result of independent interest. Our paper can be considered as a follow-up of recent work on computing the $4$-edge-connected components in linear time. However, in dealing with the computation of the $5$-edge-connected components, we are faced with unique challenges that do not appear when dealing with lower connectivity. The problem is that the $4$-edge cuts in $3$-edge-connected graphs are entangled in various complicated ways, that make it difficult to organize them in a compact way. Here we provide a novel analysis of those cuts, that reveals the existence of various interesting structures. These can be exploited so that we can disentangle and collect only those cuts that are essential in computing the $5$-edge-connected components. This analysis may provide a clue for a general solution for the $k$-edge-connected components, or other related graph connectivity problems.


title: Centralizers of Jacobian derivations

abstract: Let $\mathbb K$ be an algebraically closed field of characteristic zero, $\mathbb K[x, y]$ the polynonial ring in variables $x$, $y$ and let $W_2(\mathbb K)$ be the Lie algebra of all $\mathbb K$-derivations on $\mathbb K[x, y]$. A derivation $D \in W_2(\mathbb K)$ is called a Jacobian derivation if there exists $f \in \mathbb K[x, y]$ such that $D(h) = \det J(f, h)$ for any $h \in \mathbb K[x, y]$ (here $J(f, h)$ is the Jacobian matrix for $f$ and $h$). Such a derivation is denoted by $D_f$. The kernel of $D_f$ in $\mathbb K[x, y]$ is a subalgebra $\mathbb K[p]$ where $p=p(x, y)$ is a polynomial of smallest degree such that $f(x, y) = \varphi (p(x, y)$ for some $\varphi (t) \in \mathbb K[t]$. Let $C = C_{W_2(\mathbb K)} (D_f)$ be the centralizer of $D_f$ in $W_2(\mathbb K)$. We prove that $C$ is the free $\mathbb K[p]$-module of rank 1 or 2 over $\mathbb K[p]$ and point out a criterion of being a module of rank $2$. These results are used to obtain a class of integrable autonomous systems of differential equations.


title: Cosmic Vine: A z=3.44 large-scale structure hosting massive quiescent galaxies

abstract: We report the discovery of a large-scale structure at z=3.44 revealed by JWST data in the Extended Groth Strip (EGS) field. This structure, called the Cosmic Vine, consists of 20 galaxies with spectroscopic redshifts at 3.43<z<3.45 and six galaxy overdensities ($4-7\sigma$) with consistent photometric redshifts, making up a vine-like structure extending over a ~4x0.2 pMpc^2 area. The two most massive galaxies ($M_*\approx10^{10.9}~M_\odot$) of the Cosmic Vine are found to be quiescent with bulge-dominated morphologies ($B/T>70\%$). Comparisons with simulations suggest that the Cosmic Vine would form a cluster with halo mass $M_{\rm halo}>10^{14}M_\odot$ at z=0, and the two massive galaxies are likely forming the brightest cluster galaxies (BCGs). The results unambiguously reveal that massive quiescent galaxies can form in growing large-scale structures at z>3, thus disfavoring the environmental quenching mechanisms that require a virialized cluster core. Instead, as suggested by the interacting and bulge-dominated morphologies, the two galaxies are likely quenched by merger-triggered starburst or active galactic nucleus (AGN) feedback before falling into a cluster core. Moreover, we found that the observed specific star formation rates of massive quiescent galaxies in z>3 dense environments are one to two orders of magnitude lower than that of the BCGs in the TNG300 simulation. This discrepancy potentially poses a challenge to the models of massive cluster galaxy formation. Future studies comparing a large sample with dedicated cluster simulations are required to solve the problem.


title: Machine learning techniques to distinguish near-field interference and far-field astrophysical signals in radio telescopes

abstract: The CHIME radio telescope operates in the frequency bandwidth of 400 to 800 MHz. The CHIME/FRB collaboration has a data pipeline that analyzes the data in real time, suppresses radio frequency interferences (RFI) and searches for FRBs. However, the RFI removal techniques work best for broadband and narrow FRBs.We wish to create a RFI removal technique that works without making assumptions about the characteristics of the FRB signal. In this thesis we first explore the data of intensity generated by CHIME/FRB backend. After becoming familiar with the structure and organisation of data we present a new novel method for RFI removal using unsupervised machine learning clustering techniques by using multiple beams on CHIME telescope. We are trying to use the analogy of theory of interference for RFI removal by distinguishing near field RFI and far field astrophysical signals in the data. We explored many clustering techniques like K-means,DBSCAN etc but one technique called as HDBSCAN looks particularly promising. Using HDBSCAN clustering technique we have developed the new method for RFI removal. The removal technique upto this point has been developed by us using 3 beams of CHIME telescope. The new novel idea is still in it's incubatory phase and soon we will try to include more beams for our new RFI removal method. We have visually observed that RFI has been been considerably removed from our data. In future we are going to do more calculations to further measure the signal to noise ratio (SNR) of the FRB signal after RFI removal and we will use this technique to compare the SNR measured by current RFI removal technique at CHIME/FRB data pipeline.


title: First detection of Soft-lag in GRS 1915+105 at HFQPO using AstroSat observations

abstract: The Galactic black hole GRS 1915+105 exhibits generic High-Frequency Quasi-periodic Oscillations (HFQPOs) at $\sim$ 67 Hz only during the radio-quiet 'softer' variability classes. We present the time-lag properties associated with HFQPOs in the wide energy band (3$-$60 keV) using all AstroSat observations. For the first time, we detect soft-lag of 6$-$25 keV band w.r.t 3$-$6 keV band for all 'softer' variability classes ($\delta$, $\omega$, $\kappa$ and $\gamma$). Moreover, our findings reveal that soft-lag increases gradually with the energy of the photons. These features are entirely opposite to the previous report of hard-lag obtained with the RXTE observations. The energy-dependent time-lag study exhibits a maximum soft-lag of $\sim$ 3 ms and $\sim$ 2.5 ms for the $\delta$ and $\omega$ classes respectively, whereas the $\kappa$ and $\gamma$ classes both exhibit a maximum soft-lag of $\sim$ 2.1 ms. We find a coherent lag-energy correlation for all four variability classes, where the amplitude of soft-lag increases with energy and becomes maximum at $\sim$ 18 keV. We interpret this observed soft-lag as the reflection of hard photons in the 'cooler' accretion disc. A generic lag-rms correlation implies that the soft-lag increases with the rms amplitude of the HFQPO. The wideband (0.7$-$50 keV) spectral study suggests a high value of the optical depth ($\tau$ $\sim$ 6.90$-$12.55) of the Comptonized medium and the magnitude of the soft-lag increases linearly with the increase in optical depth ($\tau$). We explain the observed time-lag features at the HFQPOs in the context of a possible accretion disc scenario.


title: Exact overlaps for all integrable two-site boundary states of $\mathfrak{gl}(N)$ symmetric spin chains

abstract: We find closed formulas for the overlaps of Bethe eigenstates of $\mathfrak{gl}(N)$ symmetric spin chains and integrable boundary states. We derive the general overlap formulas for $\mathfrak{gl}(M)\oplus\mathfrak{gl}(N-M)$ symmetric boundary states and give a well-established conjecture for the $\mathfrak{sp}(N)$ symmetric case. Combining these results with the previously derived $\mathfrak{so}(N)$ symmetric formula, now we have the overlap functions for all integrable boundary states of the $\mathfrak{gl}(N)$ spin chains which are built from two-site states. The calculations are independent from the representations of the quantum space therefore our formulas can be applied for the $SO(6)$ and the alternating $SU(4)$ spin chains which describe the scalar sectors of $\mathcal{N}=4$ super Yang-Mills and ABJM theories which are important application areas of our results.


title: Integration of Summary Information from External Studies for Semiparametric Models

abstract: With the development of biomedical science, researchers have increasing access to an abundance of studies focusing on similar research questions. There is a growing interest in the integration of summary information from those studies to enhance the efficiency of estimation in their own internal studies. In this work, we present a comprehensive framework on integration of summary information from external studies when the data are modeled by semiparametric models. Our novel framework offers straightforward estimators that update conventional estimations with auxiliary information. It addresses computational challenges by capitalizing on the intricate mathematical structure inherent to the problem. We demonstrate the conditions when the proposed estimators are theoretically more efficient than initial estimate based solely on internal data. Several special cases such as proportional hazards model in survival analysis are provided with numerical examples.


title: Computing with Residue Numbers in High-Dimensional Representation

abstract: We introduce Residue Hyperdimensional Computing, a computing framework that unifies residue number systems with an algebra defined over random, high-dimensional vectors. We show how residue numbers can be represented as high-dimensional vectors in a manner that allows algebraic operations to be performed with component-wise, parallelizable operations on the vector elements. The resulting framework, when combined with an efficient method for factorizing high-dimensional vectors, can represent and operate on numerical values over a large dynamic range using vastly fewer resources than previous methods, and it exhibits impressive robustness to noise. We demonstrate the potential for this framework to solve computationally difficult problems in visual perception and combinatorial optimization, showing improvement over baseline methods. More broadly, the framework provides a possible account for the computational operations of grid cells in the brain, and it suggests new machine learning architectures for representing and manipulating numerical data.


title: Cavity Soliton-Induced Topological Edge States

abstract: Over the past decade, cavity solitons have attracted substantial attention for their rich dynamics and their myriad potential applications. Recently, there has been growing interest in understanding cavity solitons in systems of coupled resonators, where both new physics and applications can emerge. While numerous works have theoretically studied the interplay between cavity solitons and lattice topology, experimental demonstrations of cavity solitons in topological lattices remain elusive. Here, we experimentally realize cavity solitons in a Su-Schrieffer-Heeger (SSH) lattice and illustrate that the synergy between topology and soliton formation dynamics can induce soliton formation at the boundaries of a topological SSH lattice. Our work illustrates the rich physics of cavity solitons in topological lattices and demonstrates a flexible approach to study solitons in large-scale coupled resonator arrays.


title: A Framework for Programmability in Digital Currency

abstract: Programmable money, enabled by digital currencies, facilitates outcomes beyond simple payments by allowing users to attach conditions to the movement of funds through code. However, there is a lack of clarity on defining programmable money, where programmability can be implemented, and the resulting tradeoffs. This paper provides a definition of programmable money with four key components: a format for representing value, a set of programmable instructions, an execution environment providing a coherence guarantee, and rules around permissioning. We discuss programmability primitives, categorizing them into levels based on expressiveness. We outline four locations programmability could be offered - hardcoded into system rules, via client-supplied programs/smart contracts, in client code, or via intermediaries - analyzing benefits and risks of each. For policymakers evaluating central bank digital currencies, we recommend considering these aspects holistically and their interplay with regulation in system design. Our framework and vocabulary enable more nuanced analysis of implementing programmability.


title: Fusionize++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure Optimization

abstract: The Function-as-a-Service (FaaS) execution model increases developer productivity by removing operational concerns such as managing hardware or software runtimes. Developers, however, still need to partition their applications into FaaS functions, which is error-prone and complex: Encapsulating only the smallest logical unit of an application as a FaaS function maximizes flexibility and reusability. Yet, it also leads to invocation overheads, additional cold starts, and may increase cost due to double billing during synchronous invocations. Conversely, deploying an entire application as a single FaaS function avoids these overheads but decreases flexibility. In this paper we present Fusionize, a framework that automates optimizing for this trade-off by automatically fusing application code into an optimized multi-function composition. Developers only need to write fine-grained application code following the serverless model, while Fusionize automatically fuses different parts of the application into FaaS functions, manages their interactions, and configures the underlying infrastructure. At runtime, it monitors application performance and adapts it to minimize request-response latency and costs. Real-world use cases show that Fusionize can improve the deployment artifacts of the application, reducing both median request-response latency and cost of an example IoT application by more than 35%.


title: Systematic Reanalysis of KMTNet microlensing events, Paper I: Updates of the Photometry Pipeline and a New Planet Candidate

abstract: In this work, we update and develop algorithms for KMTNet tender-love care (TLC) photometry in order to create an new, mostly automated, TLC pipeline. We then start a project to systematically apply the new TLC pipeline to the historic KMTNet microlensing events, and search for buried planetary signals. We report the discovery of such a planet candidate in the microlensing event MOA-2019-BLG-421/KMT-2019-BLG-2991. The anomalous signal can be explained by either a planet around the lens star or the orbital motion of the source star. For the planetary interpretation, despite many degenerate solutions, the planet is most likely to be a Jovian planet orbiting an M or K dwarf, which is a typical microlensing planet. The discovery proves that the project can indeed increase the sensitivity of historic events and find previously undiscovered signals.

categories: astro-ph.EP astro-ph.GA astro-ph.IM astro-ph.SR


title: Connecting Core Galaxy Properties to the Massive Black Hole Binary Population

abstract: We investigate how the properties of massive black hole binaries influence the observed properties of core galaxies. We compare the observed trend in stellar mass deficit as a function of total stellar mass in the core galaxy with predicted trends in IllustrisTNG. We calculate mass deficits in simulated galaxies by applying sub-grid, post-processing physics based on the results of literature N-body experiments. We find the median value of the posterior distribution for the minimum binary mass ratio capable of creating a core is 0.7. For the gas mass fraction above which a core is erased we find a median value of 0.6. Thus low mass ratio binaries do not contribute to core formation and gas-rich mergers must lead to star formation within the nucleus, ultimately erasing the core. Such constraints have important implications for the overall massive black hole binary population, black hole-galaxy co-evolution, and the origin of the gravitational wave background.


title: Beyond the Standard Model prospects for kaon physics at future experiments

abstract: Rare kaon decays offer a powerful tool for investigating new physics in $s\to d$ transitions. Currently, many of the interesting decay modes are either measured with rather large uncertainties compared to their theoretical predictions or have not yet been observed. The future HIKE programme at CERN will provide unprecedented sensitivity to rare kaon decays, allowing for strong constraints on new physics scenarios with lepton flavour universality violation. We present the overall picture that emerges from a study of the different decay modes with a global analysis considering projections based on the HIKE programme, both with and without KOTO-II future measurements. We also highlight the most relevant decays and identify that in addition to the "golden channel", $K^+\to\pi^+\nu\bar\nu$, the rare $K_L\to\pi^0 \ell\bar\ell$ decay, especially in the electron sector offers strong constraints on short-distance physics.


title: LongQLoRA: Efficient and Effective Method to Extend Context Length of Large Language Models

abstract: We present LongQLoRA, an efficient and effective method to extend context length of large language models with less training resources. LongQLoRA combines the advantages of Position Interpolation, QLoRA and Shift Short Attention of LongLoRA. With a single 32GB V100 GPU, LongQLoRA can extend the context length of LLaMA2 7B and 13B from 4096 to 8192 and even to 12k within 1000 finetuning steps. LongQLoRA achieves competitive perplexity performance on PG19 and Proof-pile datasets, our model outperforms LongLoRA and is very close to MPT-7B-8K within the evaluation context length of 8192. We collect and build 39k long instruction data to extend context length of Vicuna-13B from 4096 to 8192 and achieve good performance both in long and short context generation task. We also do some ablation experiments to study the effect of LoRA rank, finetuning steps and attention patterns in inference.The model weights, training data and code are avaliable at https://github.com/yangjianxin1/LongQLoRA.


title: Inferring stochastic rates from heterogeneous snapshots of particle positions

abstract: Many imaging techniques for biological systems -- like fixation of cells coupled with fluorescence microscopy -- provide sharp spatial resolution in reporting locations of individuals at a single moment in time but also destroy the dynamics they intend to capture. These snapshot observations contain no information about individual trajectories, but still encode information about movement and demographic dynamics, especially when combined with a well-motivated biophysical model. The relationship between spatially evolving populations and single-moment representations of their collective locations is well-established with partial differential equations (PDEs) and their inverse problems. However, experimental data is commonly a set of locations whose number is insufficient to approximate a continuous-in-space PDE solution. Here, motivated by popular subcellular imaging data of gene expression, we embrace the stochastic nature of the data and investigate the mathematical foundations of parametrically inferring demographic rates from snapshots of particles undergoing birth, diffusion, and death in a nuclear or cellular domain. Toward inference, we rigorously derive a connection between individual particle paths and their presentation as a Poisson spatial process. Using this framework, we investigate the properties of the resulting inverse problem and study factors that affect quality of inference. One pervasive feature of this experimental regime is the presence of cell-to-cell heterogeneity. Rather than being a hindrance, we show that cell-to-cell geometric heterogeneity can increase the quality of inference on dynamics for certain parameter regimes. Altogether, the results serve as a basis for more detailed investigations of subcellular spatial patterns of RNA molecules and other stochastically evolving populations that can only be observed for single instants in their time evolution.

categories: q-bio.SC math.ST physics.bio-ph stat.AP stat.TH


title: Joint Transmit Signal and Beamforming Design for Integrated Sensing and Power Transfer Systems

abstract: Integrating different functionalities, conventionally implemented as dedicated systems, into a single platform allows utilising the available resources more efficiently. We consider an integrated sensing and power transfer (ISAPT) system and propose the joint optimisation of the rectangular pulse-shaped transmit signal and the beamforming vector to combine sensing and wireless power transfer (WPT) functionalities efficiently. In contrast to prior works, we adopt an accurate non-linear circuit-based energy harvesting (EH) model. We formulate and solve a non-convex optimisation problem for a general number of EH receivers to maximise a weighted sum of the average harvested powers at the EH receivers while ensuring the received echo signal reflected by a sensing target (ST) has sufficient power for estimating the range to the ST with a prescribed accuracy within the considered coverage region. The average harvested power is shown to monotonically increase with the pulse duration when the average transmit power budget is sufficiently large. We discuss the trade-off between sensing performance and power transfer for the considered ISAPT system. The proposed approach significantly outperforms a heuristic baseline scheme based on a linear EH model, which linearly combines energy beamforming with the beamsteering vector in the direction to the ST as its transmit strategy.


title: Light Fields during Inflation from BOSS and Future Galaxy Surveys

abstract: Primordial non-Gaussianity generated by additional fields present during inflation offers a compelling observational target for galaxy surveys. These fields are of significant theoretical interest since they offer a window into particle physics in the inflaton sector. They also violate the single-field consistency conditions and induce a scale-dependent bias in the galaxy power spectrum. In this paper, we explore this particular signal for light scalar fields and study the prospects for measuring it with galaxy surveys. We find that the sensitivities of current and future surveys are remarkably stable for different configurations, including between spectroscopic and photometric redshift measurements. This is even the case at non-zero masses where the signal is not obviously localized on large scales. For realistic galaxy number densities, we demonstrate that the redshift range and galaxy bias of the sample have the largest impact on the sensitivity in the power spectrum. These results additionally motivated us to explore the potentially enhanced sensitivity of Vera Rubin Observatory's LSST through multi-tracer analyses. Finally, we apply this understanding to current data from the last data release of the Baryon Oscillation Spectroscopic Survey (BOSS DR12) and place new constraints on light fields coupled to the inflaton.


title: Extremal surfaces in glue-on AdS/$T\bar T$ holography

abstract: $T\bar T$ deformed CFTs with positive deformation parameter have been proposed to be holographically dual to Einstein gravity in a glue-on $\mathrm{AdS}_3$ spacetime. The latter is constructed from AdS$_3$ by gluing a patch of an auxiliary AdS$_3^*$ spacetime to its asymptotic boundary. In this work, we propose a glue-on version of the Ryu-Takayanagi formula, which is given by the signed area of an extremal surface. The extremal surface is anchored at the endpoints of an interval on a cutoff surface in the glue-on geometry. It consists of an RT surface lying in the AdS$_3$ part of the spacetime and its extension to the AdS$_3^*$ region. The signed area is the length of the RT surface minus the length of the segments in AdS$_3^*$. We find that the Ryu-Takayanagi formula with the signed area reproduces the entanglement entropy of a half interval for $T\bar T$-deformed CFTs on the sphere. We then study the properties of extremal surfaces on various glue-on geometries, including Poincar\'e $\mathrm{AdS}_3$, global $\mathrm{AdS}_3$, and the BTZ black hole. When anchored on multiple intervals at the boundary, the signed area of the minimal surfaces undergoes phase transitions with novel properties. In all of these examples, we find that the glue-on extremal surfaces exhibit a minimum length related to the deformation parameter of $T\bar T$-deformed CFTs.


title: The Adams isomorphism revisited

abstract: We establish abstract Adams isomorphisms in an arbitrary equivariantly presentable equivariantly semiadditive global category. This encompasses the well-known Adams isomorphism in equivariant stable homotopy theory, and applies more generally in the settings of $G$-Mackey functors, $G$-global homotopy theory, and equivariant Kasparov categories.


title: Profiling Irony & Stereotype: Exploring Sentiment, Topic, and Lexical Features

abstract: Social media has become a very popular source of information. With this popularity comes an interest in systems that can classify the information produced. This study tries to create such a system detecting irony in Twitter users. Recent work emphasize the importance of lexical features, sentiment features and the contrast herein along with TF-IDF and topic models. Based on a thorough feature selection process, the resulting model contains specific sub-features from these areas. Our model reaches an F1-score of 0.84, which is above the baseline. We find that lexical features, especially TF-IDF, contribute the most to our models while sentiment and topic modeling features contribute less to overall performance. Lastly, we highlight multiple interesting and important paths for further exploration.


title: SEMQA: Semi-Extractive Multi-Source Question Answering

abstract: Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and automatically evaluating their accuracy remains an ongoing challenge. In this work, we introduce a new QA task for answering multi-answer questions by summarizing multiple diverse sources in a semi-extractive fashion. Specifically, Semi-extractive Multi-source QA (SEMQA) requires models to output a comprehensive answer, while mixing factual quoted spans -- copied verbatim from given input sources -- and non-factual free-text connectors that glue these spans together into a single cohesive passage. This setting bridges the gap between the outputs of well-grounded but constrained extractive QA systems and more fluent but harder to attribute fully abstractive answers. Particularly, it enables a new mode for language models that leverages their advanced language generation capabilities, while also producing fine in-line attributions by-design that are easy to verify, interpret, and evaluate. To study this task, we create the first dataset of this kind, QuoteSum, with human-written semi-extractive answers to natural and generated questions, and define text-based evaluation metrics. Experimenting with several LLMs in various settings, we find this task to be surprisingly challenging, demonstrating the importance of QuoteSum for developing and studying such consolidation capabilities.


title: AutoChip: Automating HDL Generation Using LLM Feedback

abstract: Traditionally, designs are written in Verilog hardware description language (HDL) and debugged by hardware engineers. While this approach is effective, it is time-consuming and error-prone for complex designs. Large language models (LLMs) are promising in automating HDL code generation. LLMs are trained on massive datasets of text and code, and they can learn to generate code that compiles and is functionally accurate. We aim to evaluate the ability of LLMs to generate functionally correct HDL models. We build AutoChip by combining the interactive capabilities of LLMs and the output from Verilog simulations to generate Verilog modules. We start with a design prompt for a module and the context from compilation errors and debugging messages, which highlight differences between the expected and actual outputs. This ensures that accurate Verilog code can be generated without human intervention. We evaluate AutoChip using problem sets from HDLBits. We conduct a comprehensive analysis of the AutoChip using several LLMs and problem categories. The results show that incorporating context from compiler tools, such as Icarus Verilog, improves the effectiveness, yielding 24.20% more accurate Verilog. We release our evaluation scripts and datasets as open-source contributions at the following link https://github.com/shailja-thakur/AutoChip.


title: Towards Few-Annotation Learning in Computer Vision: Application to Image Classification and Object Detection tasks

abstract: In this thesis, we develop theoretical, algorithmic and experimental contributions for Machine Learning with limited labels, and more specifically for the tasks of Image Classification and Object Detection in Computer Vision. In a first contribution, we are interested in bridging the gap between theory and practice for popular Meta-Learning algorithms used in Few-Shot Classification. We make connections to Multi-Task Representation Learning, which benefits from solid theoretical foundations, to verify the best conditions for a more efficient meta-learning. Then, to leverage unlabeled data when training object detectors based on the Transformer architecture, we propose both an unsupervised pretraining and a semi-supervised learning method in two other separate contributions. For pretraining, we improve Contrastive Learning for object detectors by introducing the localization information. Finally, our semi-supervised method is the first tailored to transformer-based detectors.


title: Asymmetric graphs with quantum symmetry

abstract: We present a sequence of finite graphs with trivial automorphism group and non-trivial quantum automorphism group, which are the first known examples of graphs with this property. The examples are based on solution groups to (binary) linear systems. We first show that the dual of every solution group occurs as the quantum automorphism group of some graph, and then construct an infinite sequence of systems whose solution groups are nontrivial but perfect, i.e., they have trivial abelianizations. We also prove a weak quantum analog of Frucht's theorem, namely that every classical finite group $\Gamma$ can occur as the quantum automorphism group of a graph. Moreover there are graphs $G_1$ and $G_2$ such that $\mathrm{Aut}(G_1) \cong \Gamma \cong \mathrm{Aut}(G_2)$, but $\mathrm{Qut}(G_1) \not \cong \mathrm{Qut}(G_2)$ for any finite group $\Gamma$. This allows us to answer several open questions from the literature, such as proving that there do not exist any "quantum excluding groups". Additionally, we present a procedure that allows us to decolor the vertices of any vertex-colored graph while preserving its quantum automorphism group.


title: d-Wave Hall effect and linear magnetoconductivity in metallic collinear antiferromagnets

abstract: In this paper we theoretically predict a distinct class of anomalous Hall effects occurring in metallic collinear antiferromagnets. The effect is quadratic and $d-$wave symmetric in external magnetic field. In addition, the electric current, transverse to the current voltage drop and the magnetic field in the predicted effect are all in the same plane. Studied theoretical model consists of two-dimensional fermions interacting with the Neel order through momentum dependent exchange interaction having a $d-$wave symmetry. We also find unusual linear magnetoconductivity in this model.


title: Quantum automorphism groups of trees

abstract: We give a characterisation of quantum automorphism groups of trees. In particular, for every tree, we show how to iteratively construct its quantum automorphism group using free products and free wreath products. This can be considered a quantum version of Jordan's theorem for the automorphism groups of trees. This is one of the first characterisations of quantum automorphism groups of a natural class of graphs with quantum symmetry.


title: Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs

abstract: Recent works have showcased the ability of LLMs to embody diverse personas in their responses, exemplified by prompts like 'You are Yoda. Explain the Theory of Relativity.' While this ability allows personalization of LLMs and enables human behavior simulation, its effect on LLMs' capabilities remains unclear. To fill this gap, we present the first extensive study of the unintended side-effects of persona assignment on the ability of LLMs to perform basic reasoning tasks. Our study covers 24 reasoning datasets, 4 LLMs, and 19 diverse personas (e.g. an Asian person) spanning 5 socio-demographic groups. Our experiments unveil that LLMs harbor deep rooted bias against various socio-demographics underneath a veneer of fairness. While they overtly reject stereotypes when explicitly asked ('Are Black people less skilled at mathematics?'), they manifest stereotypical and erroneous presumptions when asked to answer questions while adopting a persona. These can be observed as abstentions in responses, e.g., 'As a Black person, I can't answer this question as it requires math knowledge', and generally result in a substantial performance drop. Our experiments with ChatGPT-3.5 show that this bias is ubiquitous - 80% of our personas demonstrate bias; it is significant - some datasets show performance drops of 70%+; and can be especially harmful for certain groups - some personas suffer statistically significant drops on 80%+ of the datasets. Overall, all 4 LLMs exhibit this bias to varying extents, with GPT-4-Turbo showing the least but still a problematic amount of bias (evident in 42% of the personas). Further analysis shows that these persona-induced errors can be hard-to-discern and hard-to-avoid. Our findings serve as a cautionary tale that the practice of assigning personas to LLMs - a trend on the rise - can surface their deep-rooted biases and have unforeseeable and detrimental side-effects.


title: Maximum Entropy Principle as Postulate of Quantum Mechanics

abstract: Even a century after the formulation of Quantum Mechanics (QM), the wave function collapse (WFC) remains a contentious aspect of the theory. Environment-induced decoherence has offered a partial resolution by illustrating how unitary evolution in an open quantum system can lead to effective WFC within its components. However, this approach by itself does not lead to a fully self-consistent reformulation of QM. We introduce a modified set of QM postulates, which exclude both WFC and Born's probability rule. They are replaced with the Maximum Entropy Principle, a weaker postulate that specifies conditional probabilities for mutually compatible observations. Within this formulation, both WFC and Born's rule become emerging properties.


title: DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets

abstract: Construction of a universal detector poses a crucial question: How can we most effectively train a model on a large mixture of datasets? The answer lies in learning dataset-specific features and ensembling their knowledge but do all this in a single model. Previous methods achieve this by having separate detection heads on a common backbone but that results in a significant increase in parameters. In this work, we present Mixture-of-Experts as a solution, highlighting that MoEs are much more than a scalability tool. We propose Dataset-Aware Mixture-of-Experts, DAMEX where we train the experts to become an `expert' of a dataset by learning to route each dataset tokens to its mapped expert. Experiments on Universal Object-Detection Benchmark show that we outperform the existing state-of-the-art by average +10.2 AP score and improve over our non-MoE baseline by average +2.0 AP score. We also observe consistent gains while mixing datasets with (1) limited availability, (2) disparate domains and (3) divergent label sets. Further, we qualitatively show that DAMEX is robust against expert representation collapse.


title: The Monadic Theory of Toric Words

abstract: For which unary predicates $P_1, \ldots, P_m$ is the MSO theory of the structure $\langle \mathbb{N}; <, P_1, \ldots, P_m \rangle$ decidable? We survey the state of the art, leading us to investigate combinatorial properties of almost-periodic, morphic, and toric words. In doing so, we show that if each $P_i$ can be generated by a toric dynamical system of a certain kind, then the attendant MSO theory is decidable.


title: Machine-learning optimized measurements of chaotic dynamical systems via the information bottleneck

abstract: Deterministic chaos permits a precise notion of a "perfect measurement" as one that, when obtained repeatedly, captures all of the information created by the system's evolution with minimal redundancy. Finding an optimal measurement is challenging, and has generally required intimate knowledge of the dynamics in the few cases where it has been done. We establish an equivalence between a perfect measurement and a variant of the information bottleneck. As a consequence, we can employ machine learning to optimize measurement processes that efficiently extract information from trajectory data. We obtain approximately optimal measurements for multiple chaotic maps and lay the necessary groundwork for efficient information extraction from general time series.


title: Future Lens: Anticipating Subsequent Tokens from a Single Hidden State

abstract: We conjecture that hidden state vectors corresponding to individual input tokens encode information sufficient to accurately predict several tokens ahead. More concretely, in this paper we ask: Given a hidden (internal) representation of a single token at position $t$ in an input, can we reliably anticipate the tokens that will appear at positions $\geq t + 2$? To test this, we measure linear approximation and causal intervention methods in GPT-J-6B to evaluate the degree to which individual hidden states in the network contain signal rich enough to predict future hidden states and, ultimately, token outputs. We find that, at some layers, we can approximate a model's output with more than 48% accuracy with respect to its prediction of subsequent tokens through a single hidden state. Finally we present a "Future Lens" visualization that uses these methods to create a new view of transformer states.


title: Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How

abstract: Recent years have seen considerable progress in the continual training of deep neural networks, predominantly thanks to approaches that add replay or regularization terms to the loss function to approximate the joint loss over all tasks so far. However, we show that even with a perfect approximation to the joint loss, these approaches still suffer from temporary but substantial forgetting when starting to train on a new task. Motivated by this 'stability gap', we propose that continual learning strategies should focus not only on the optimization objective, but also on the way this objective is optimized. While there is some continual learning work that alters the optimization trajectory (e.g., using gradient projection techniques), this line of research is positioned as alternative to improving the optimization objective, while we argue it should be complementary. In search of empirical support for our proposition, we perform a series of pre-registered experiments combining replay-approximated joint objectives with gradient projection-based optimization routines. However, this first experimental attempt fails to show clear and consistent benefits. Nevertheless, our conceptual arguments, as well as some of our empirical results, demonstrate the distinctive importance of the optimization trajectory in continual learning, thereby opening up a new direction for continual learning research.


title: Floquet engineering of binding in doped and photo-doped Mott insulators

abstract: We investigate the emergence of bound states in chemically and photo-doped Mott insulators, mediated by spin and $\eta$-pairing fluctuations within both 2-leg ladder and 2D systems. To effectively describe the photo and chemically doped state on the same footings, we employ the Schrieffer-Wolff transformation, resulting in a generalized $t$-$J$ model. Our results demonstrate that the binding energies and localization length in the chemically and photo-doped regimes are comparable, with $\eta$-pairing fluctuations not playing a crucial role. Furthermore, we show that manipulating the binding is possible through external periodic driving, a technique known as Floquet engineering, leading to significantly enhanced binding energies. We also roughly estimate the lifetime of photo-doped states under periodic driving conditions based on the Fermi golden rule. Lastly, we propose experimental protocols for realizing Hubbard excitons in cold-atom experiments.


title: How Abstract Is Linguistic Generalization in Large Language Models? Experiments with Argument Structure

abstract: Language models are typically evaluated on their success at predicting the distribution of specific words in specific contexts. Yet linguistic knowledge also encodes relationships between contexts, allowing inferences between word distributions. We investigate the degree to which pre-trained Transformer-based large language models (LLMs) represent such relationships, focusing on the domain of argument structure. We find that LLMs perform well in generalizing the distribution of a novel noun argument between related contexts that were seen during pre-training (e.g., the active object and passive subject of the verb spray), succeeding by making use of the semantically-organized structure of the embedding space for word embeddings. However, LLMs fail at generalizations between related contexts that have not been observed during pre-training, but which instantiate more abstract, but well-attested structural generalizations (e.g., between the active object and passive subject of an arbitrary verb). Instead, in this case, LLMs show a bias to generalize based on linear order. This finding points to a limitation with current models and points to a reason for which their training is data-intensive.s reported here are available at https://github.com/clay-lab/structural-alternations.


title: GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs

abstract: Recent works have shown that Large Language Models (LLMs) could empower traditional neuro-symbolic models via programming capabilities to translate language into module descriptions, thus achieving strong visual reasoning results while maintaining the model's transparency and efficiency. However, these models usually exhaustively generate the entire code snippet given each new instance of a task, which is extremely ineffective. We propose generative neuro-symbolic visual reasoning by growing and reusing modules. Specifically, our model consists of three unique stages, module initialization, module generation, and module execution. First, given a vision-language task, we adopt LLMs to examine whether we could reuse and grow over established modules to handle this new task. If not, we initialize a new module needed by the task and specify the inputs and outputs of this new module. After that, the new module is created by querying LLMs to generate corresponding code snippets that match the requirements. In order to get a better sense of the new module's ability, we treat few-shot training examples as test cases to see if our new module could pass these cases. If yes, the new module is added to the module library for future reuse. Finally, we evaluate the performance of our model on the testing set by executing the parsed programs with the newly made visual modules to get the results. We find the proposed model possesses several advantages. First, it performs competitively on standard tasks like visual question answering and referring expression comprehension; Second, the modules learned from one task can be seamlessly transferred to new tasks; Last but not least, it is able to adapt to new visual reasoning tasks by observing a few training examples and reusing modules.


title: Beyond Size: How Gradients Shape Pruning Decisions in Large Language Models

abstract: Large Language Models (LLMs) with billions of parameters are prime targets for network pruning, removing some model weights without hurting performance. Prior approaches such as magnitude pruning, SparseGPT, and Wanda, either concentrated solely on weights or integrated weights with activations for sparsity. However, they overlooked the informative gradients derived from pretrained LLMs. In this paper, we present a novel sparsity-centric pruning method for pretrained LLMs, termed Gradient-based Language Model Pruner (GBLM-Pruner). GBLM-Pruner leverages the first-order term of the Taylor expansion, operating in a training-free manner by harnessing properly normalized gradients from a few calibration samples to determine the pruning metric, and substantially outperforms competitive counterparts like SparseGPT and Wanda in multiple benchmarks. Intriguingly, by incorporating gradients, unstructured pruning with our method tends to reveal some structural patterns, which mirrors the geometric interdependence inherent in the LLMs' parameter structure. Additionally, GBLM-Pruner functions without any subsequent retraining or weight updates to maintain its simplicity as other counterparts. Extensive evaluations on LLaMA-1 and LLaMA-2 across various benchmarks show that GBLM-Pruner surpasses magnitude pruning, Wanda and SparseGPT by significant margins. We further extend our approach on Vision Transformer. Our code and models are available at https://github.com/VILA-Lab/GBLM-Pruner.


title: TESS photometry of the nova eruption in V606 Vul: asymmetric photosphere and multiple ejections?

abstract: Lightcurves of many classical novae deviate from the canonical "fast rise - smooth decline" pattern and display complex variability behavior. We present the first TESS-space-photometry-based investigation of this phenomenon. We use TESS Sector 41 full-frame images to extract a lightcurve of the slow Galactic nova V606 Vul that erupted nine days prior to the start of the TESS observations. The lightcurve covers the first of two major peaks of V606 Vul that was reached 19 days after the start of the eruption. The nova reached its brightest visual magnitude V=9.9 in its second peak 64 days after the eruption onset, following the completion of Sector 41 observations. To increase the confidence level of the extracted lightcurve, we performed the analysis using four different codes implementing the aperture photometry (Lightkurve, VaST) and image subtraction (TESSreduce, tequila_shots) and find good agreement between them. We performed ground-based photometric and spectroscopic monitoring to complement the TESS data. The TESS lightcurve reveals two features: periodic variations (0.12771d, 0.01mag average peak-to-peak amplitude) that disappeared when the source was within 1mag of peak optical brightness and a series of isolated mini-flares (with peak-to-peak amplitudes of up to 0.5mag) appearing at seemingly random times. We interpret the periodic variations as the result of azimuthal asymmetry of the photosphere engulfing the nova-hosting binary that was distorted by and rotating with the binary. Whereas we use spectra to associate the two major peaks in the nova lightcurve with distinct episodes of mass ejection, the origin of mini-flares remains elusive.


title: SciDataFlow: A Tool for Improving the Flow of Data through Science

abstract: Managing data and code in open scientific research is complicated by two key problems: large datasets often cannot be stored alongside code in repository platforms like GitHub, and iterative analysis can lead to unnoticed changes to data, increasing the risk that analyses are based on older versions of data. Here, I introduce SciDataFlow: a fast, concurrent command-line tool paired with a simple Data Manifest specification. SciDataFlow streamlines tracking data changes, uploading data to remote repositories, and pulling in all data necessary to reproduce a computational analysis.


title: Detecting Relevant Information in High-Volume Chat Logs: Keyphrase Extraction for Grooming and Drug Dealing Forensic Analysis

abstract: The growing use of digital communication platforms has given rise to various criminal activities, such as grooming and drug dealing, which pose significant challenges to law enforcement and forensic experts. This paper presents a supervised keyphrase extraction approach to detect relevant information in high-volume chat logs involving grooming and drug dealing for forensic analysis. The proposed method, JointKPE++, builds upon the JointKPE keyphrase extractor by employing improvements to handle longer texts effectively. We evaluate JointKPE++ using BERT-based pre-trained models on grooming and drug dealing datasets, including BERT, RoBERTa, SpanBERT, and BERTimbau. The results show significant improvements over traditional approaches and demonstrate the potential for JointKPE++ to aid forensic experts in efficiently detecting keyphrases related to criminal activities.


title: FlaCGEC: A Chinese Grammatical Error Correction Dataset with Fine-grained Linguistic Annotation

abstract: Chinese Grammatical Error Correction (CGEC) has been attracting growing attention from researchers recently. In spite of the fact that multiple CGEC datasets have been developed to support the research, these datasets lack the ability to provide a deep linguistic topology of grammar errors, which is critical for interpreting and diagnosing CGEC approaches. To address this limitation, we introduce FlaCGEC, which is a new CGEC dataset featured with fine-grained linguistic annotation. Specifically, we collect raw corpus from the linguistic schema defined by Chinese language experts, conduct edits on sentences via rules, and refine generated samples manually, which results in 10k sentences with 78 instantiated grammar points and 3 types of edits. We evaluate various cutting-edge CGEC methods on the proposed FlaCGEC dataset and their unremarkable results indicate that this dataset is challenging in covering a large range of grammatical errors. In addition, we also treat FlaCGEC as a diagnostic dataset for testing generalization skills and conduct a thorough evaluation of existing CGEC models.


title: In nomine patris... Elements for a semantics of medieval paternity

abstract: This article examines medieval concepts of paternity and father-son relationships through the digital analysis of medieval textual corpora. Although historians have access to enormous digital collections in 2023, they have rarely fully exploited these resources. The author proposes a historical semantic approach to this theme, using modeling tools and text mining in general, to analyze the evolution of terms related to paternity. The study proposes three conclusions: 1. a semantic break occurred in the semantic field of paternity at the turn of Antiquity and the Early Middle Ages. The meaning of pater and its derivatives changed radically over the course of the 4th-6th centuries, particularly as a result of the influence of the dogma of the Christian Trinity. Medieval fatherhood was multidimensional, encompassing both biological and spiritual aspects, in other words, complex relationships between multiple carnal and spiritual (i.e. divine) fathers. 2. The role of spiritual kinship is crucial to understanding medieval fatherhood, as the work of Anita Guerreau-Jalabert and J{\'e}r{\^o}me Baschet has already shown. Initially attributed to God, this ''ideal paternity'' (paternitas) gradually extended to members of the Church (popes, bishops, abbots), underlining at the same time the growing importance of spiritual kinship over biological kinship over the centuries studied. 3. To reveal these structures, invisible to the naked eye, an interdisciplinary approach is rigorously required. Complementary investigations into the lemmas mater, filia, frater and other family terms are required. The use of digital tools and historical semantic analysis opens up new perspectives for researchers in history, anthropology, linguistics and data mining, enabling them to explore the representation systems of ancient societies in depth and with nuance.


title: Education journal rankings: A diversity-based Author Affiliation Index assessment methodology

abstract: Determining the reputation of academic journals is an crucial issue. The Author Affiliation Index (AAI) was proposed as a novel indicator for judging journal quality in many academic disciplines. Nevertheless, the original AAI has several potential limitations, some of which have been discussed and addressed in previous studies. In this paper, we modified the original AAI by incorporating diversity of top-notch institutions, namely the AAID, exploring how institutional diversity is related to journal quality assessment. We further conducted a quality assessment of 263 education journals indexed in the Social Sciences Citation Index (SSCI) by applying the AAID, AAI and weighted AAI. We find that the AAID ranking possesses a low correlation coefficient with the Journal Impact Factor (JIF) and Eigenfactor Score (ES). That is to say, the AAID rating has not reached a good agreement with the most popular ranking indicators JIF and ES for journals in the field of education. Moreover, we analyze the reasons for the highest AAID from the structure of complex networks. Overall, the AAID is an alternative indicator for evaluating the prestige of journals from a new perspective.


title: Streetlight Effect in Post-Publication Peer Review: Are Open Access Publications More Scrutinized?

abstract: The Streetlight Effect represents an observation bias that occurs when individuals search for something only where it is easiest to look. Despite the significant development of Post-Publication Peer Review (PPPR) in recent years, facilitated in part by platforms such as PubPeer, existing literature has not examined whether PPPR is affected by this type of bias. In other words, if the PPPR mainly concerns publications to which researchers have direct access (eg to analyze image duplications, etc.). In this study, we compare the Open Access (OA) structures of publishers and journals among 51,882 publications commented on PubPeer to those indexed in OpenAlex database (\#156,700,177). Our findings indicate that OA journals are 33% more prevalent in PubPeer than in the global total (52% for the most commented journals). This result can be attributed to disciplinary bias in PubPeer, with overrepresentation of medical and biological research (which exhibits higher levels of openness). However, after normalization, the results reveal that PPPR does not exhibit a Streetlight Effect, as OA publications, within the same discipline, are on average 16% less prevalent in PubPeer than in the global total. These results suggest that the process of scientific self-correction operates independently of publication access status.


title: Ontology-Driven Processing of Transdisciplinary Domain Knowledge

abstract: The monograph discusses certain aspects of modern real-world problems facing humanity, which are much more challenging than scientific ones. Modern science is unable to solve them in a fundamental way. Vernadsky's noosphere thesis, in fact, appeals to the scientific worldview that needs to be built in a way that overcomes the interdisciplinary barriers and increases the effectiveness of interdisciplinary interaction and modern science overall. We are talking about the general transdisciplinary knowledge. In world practice, there is still no systematic methodology and a specific form of generally accepted valid scientific theory that would provide transdisciplinary knowledge. Non-linear interdisciplinary interaction is the standard of evolution of modern science. At the same time, a new transdisciplinary theory (domain of scientific research) is being de facto created and the process is repeated many times: from an individual or group of disciplines, through interdisciplinary interaction, in a direction that brings us closer to creating a holistic general scientific worldview.


title: From Text to Structure: Using Large Language Models to Support the Development of Legal Expert Systems

abstract: Encoding legislative text in a formal representation is an important prerequisite to different tasks in the field of AI & Law. For example, rule-based expert systems focused on legislation can support laypeople in understanding how legislation applies to them and provide them with helpful context and information. However, the process of analyzing legislation and other sources to encode it in the desired formal representation can be time-consuming and represents a bottleneck in the development of such systems. Here, we investigate to what degree large language models (LLMs), such as GPT-4, are able to automatically extract structured representations from legislation. We use LLMs to create pathways from legislation, according to the JusticeBot methodology for legal decision support systems, evaluate the pathways and compare them to manually created pathways. The results are promising, with 60% of generated pathways being rated as equivalent or better than manually created ones in a blind comparison. The approach suggests a promising path to leverage the capabilities of LLMs to ease the costly development of systems based on symbolic approaches that are transparent and explainable.


title: ezBIDS: Guided standardization of neuroimaging data interoperable with major data archives and platforms

abstract: Data standardization has become one of the leading methods neuroimaging researchers rely on for data sharing and reproducibility. Data standardization promotes a common framework through which researchers can utilize others' data. Yet, as of today, formatting datasets that adhere to community best practices requires technical expertise involving coding and considerable knowledge of file formats and standards. We describe ezBIDS, a tool for converting neuroimaging data and associated metadata to the Brain Imaging Data Structure (BIDS) standard. ezBIDS provides four unique features: (1) No installation or programming requirements. (2) Handling of both imaging and task events data and metadata. (3) Automated inference and guidance for adherence to BIDS. (4) Multiple data management options: download BIDS data to local system, or transfer to OpenNeuro.org or brainlife.io. In sum, ezBIDS requires neither coding proficiency nor knowledge of BIDS and is the first BIDS tool to offer guided standardization, support for task events conversion, and interoperability with OpenNeuro and brainlife.io.


title: An Improved Transformer-based Model for Detecting Phishing, Spam, and Ham: A Large Language Model Approach

abstract: Phishing and spam detection is long standing challenge that has been the subject of much academic research. Large Language Models (LLM) have vast potential to transform society and provide new and innovative approaches to solve well-established challenges. Phishing and spam have caused financial hardships and lost time and resources to email users all over the world and frequently serve as an entry point for ransomware threat actors. While detection approaches exist, especially heuristic-based approaches, LLMs offer the potential to venture into a new unexplored area for understanding and solving this challenge. LLMs have rapidly altered the landscape from business, consumers, and throughout academia and demonstrate transformational potential for the potential of society. Based on this, applying these new and innovative approaches to email detection is a rational next step in academic research. In this work, we present IPSDM, our model based on fine-tuning the BERT family of models to specifically detect phishing and spam email. We demonstrate our fine-tuned version, IPSDM, is able to better classify emails in both unbalanced and balanced datasets. This work serves as an important first step towards employing LLMs to improve the security of our information systems.


title: Normalized solutions for Sch\"odinger equations with potential and general nonlinearities involving critical case on large convex domains

abstract: In this paper, we study the following Schr\"odinger equations with potentials and general nonlinearities \begin{equation*} \left\{\begin{aligned} & -\Delta u+V(x)u+\lambda u=|u|^{q-2}u+\beta f(u), \\ & \int |u|^2dx=\Theta, \end{aligned} \right. \end{equation*} both on $\mathbb{R}^N$ as well as on domains $r \Omega$ where $\Omega \subset \mathbb{R}^N$ is an open bounded convex domain and $r>0$ is large. The exponent satisfies $2+\frac{4}{N}\leq q\leq2^*=\frac{2 N}{N-2}$ and $f:\mathbb{R}\rightarrow \mathbb{R}$ satisfies $L^2$-subcritical or $L^2$-critical growth. This paper generalizes the conclusion of Bartsch et al. in \cite{TBAQ2023}(2023, arXiv preprint). Moreover, we consider the Sobolev critical case and $L^2$-critical case of the above problem.


title: Chain of Empathy: Enhancing Empathetic Response of Large Language Models Based on Psychotherapy Models

abstract: We present a novel method, the Chain of Empathy (CoE) prompting, that utilizes insights from psychotherapy to induce Large Language Models (LLMs) to reason about human emotional states. This method is inspired by various psychotherapy approaches including Cognitive Behavioral Therapy (CBT), Dialectical Behavior Therapy (DBT), Person Centered Therapy (PCT), and Reality Therapy (RT), each leading to different patterns of interpreting clients' mental states. LLMs without reasoning generated predominantly exploratory responses. However, when LLMs used CoE reasoning, we found a more comprehensive range of empathetic responses aligned with the different reasoning patterns of each psychotherapy model. The CBT based CoE resulted in the most balanced generation of empathetic responses. The findings underscore the importance of understanding the emotional context and how it affects human and AI communication. Our research contributes to understanding how psychotherapeutic models can be incorporated into LLMs, facilitating the development of context-specific, safer, and empathetic AI.


title: Explainable Identification of Hate Speech towards Islam using Graph Neural Networks

abstract: Islamophobic language is a prevalent challenge on online social interaction platforms. Identifying and eliminating such hatred is a crucial step towards a future of harmony and peace. This study presents a novel paradigm for identifying and explaining hate speech towards Islam using graph neural networks. Utilizing the intrinsic ability of graph neural networks to find, extract, and use relationships across disparate data points, our model consistently achieves outstanding performance while offering explanations for the underlying correlations and causation.


title: Adapting Fake News Detection to the Era of Large Language Models

abstract: In the age of large language models (LLMs) and the widespread adoption of AI-driven content creation, the landscape of information dissemination has witnessed a paradigm shift. With the proliferation of both human-written and machine-generated real and fake news, robustly and effectively discerning the veracity of news articles has become an intricate challenge. While substantial research has been dedicated to fake news detection, this either assumes that all news articles are human-written or abruptly assumes that all machine-generated news are fake. Thus, a significant gap exists in understanding the interplay between machine-(paraphrased) real news, machine-generated fake news, human-written fake news, and human-written real news. In this paper, we study this gap by conducting a comprehensive evaluation of fake news detectors trained in various scenarios. Our primary objectives revolve around the following pivotal question: How to adapt fake news detectors to the era of LLMs? Our experiments reveal an interesting pattern that detectors trained exclusively on human-written articles can indeed perform well at detecting machine-generated fake news, but not vice versa. Moreover, due to the bias of detectors against machine-generated texts \cite{su2023fake}, they should be trained on datasets with a lower machine-generated news ratio than the test set. Building on our findings, we provide a practical strategy for the development of robust fake news detectors.


title: Low-Resource Named Entity Recognition: Can One-vs-All AUC Maximization Help?

abstract: Named entity recognition (NER), a task that identifies and categorizes named entities such as persons or organizations from text, is traditionally framed as a multi-class classification problem. However, this approach often overlooks the issues of imbalanced label distributions, particularly in low-resource settings, which is common in certain NER contexts, like biomedical NER (bioNER). To address these issues, we propose an innovative reformulation of the multi-class problem as a one-vs-all (OVA) learning problem and introduce a loss function based on the area under the receiver operating characteristic curve (AUC). To enhance the efficiency of our OVA-based approach, we propose two training strategies: one groups labels with similar linguistic characteristics, and another employs meta-learning. The superiority of our approach is confirmed by its performance, which surpasses traditional NER learning in varying NER settings.


title: The Impact of Preference Agreement in Reinforcement Learning from Human Feedback: A Case Study in Summarization

abstract: Reinforcement Learning from Human Feedback (RLHF) can be used to capture complex and nuanced properties of text generation quality. As a result, the task of text summarization has been identified as a good candidate for this process. In this paper, we explore how preference agreement impacts the efficacy of RLHF for summarization. We show that sampling human preferences to include a range of annotator agreement results in (1) higher accuracy reward models and (2) alters the characteristics of quality captured. We additionally show improvements in downstream generation when using a reward model trained with a range of preference agreements. Our contributions have implications for the design of synthetic datasets as well as the importance of considering quality differentials in comparison-based data.


title: Bayesian mortality modelling with pandemics: a vanishing jump approach

abstract: This paper extends the Lee-Carter model to include vanishing jumps on mortality rates, where the impact is highest in the beginning and then gradually diminishes. Existing models either account for transitory jumps over one period or permanent shifts. However, there is no literature on estimating mortality time series with jumps that have a vanishing effect over a small number of periods, as is typically observed in pandemics. Using COVID-19 data, our proposed Bayesian model outperforms transitory shock models in terms of in-sample fit, thus providing a more comprehensive representation of mortality rates during a pandemic.


title: Successor Features for Efficient Multisubject Controlled Text Generation

abstract: While large language models (LLMs) have achieved impressive performance in generating fluent and realistic text, controlling the generated text so that it exhibits properties such as safety, factuality, and non-toxicity remains challenging. % such as DExperts, GeDi, and rectification Existing decoding-based methods are static in terms of the dimension of control; if the target subject is changed, they require new training. Moreover, it can quickly become prohibitive to concurrently control multiple subjects. In this work, we introduce SF-GEN, which is grounded in two primary concepts: successor features (SFs) to decouple the LLM's dynamics from task-specific rewards, and language model rectification to proportionally adjust the probability of selecting a token based on the likelihood that the finished text becomes undesired. SF-GEN seamlessly integrates the two to enable dynamic steering of text generation with no need to alter the LLM's parameters. Thanks to the decoupling effect induced by successor features, our method proves to be memory-wise and computationally efficient for training as well as decoding, especially when dealing with multiple target subjects. To the best of our knowledge, our research represents the first application of successor features in text generation. In addition to its computational efficiency, the resultant language produced by our method is comparable to the SOTA (and outperforms baselines) in both control measures as well as language quality, which we demonstrate through a series of experiments in various controllable text generation tasks.


title: Are cascade dialogue state tracking models speaking out of turn in spoken dialogues?

abstract: In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs is key to a smooth interaction. Traditionally TOD systems are composed of several modules that interact with one another. While each of these components is the focus of active research communities, their behavior in interaction can be overlooked. This paper proposes a comprehensive analysis of the errors of state of the art systems in complex settings such as Dialogue State Tracking which highly depends on the dialogue context. Based on spoken MultiWoz, we identify that errors on non-categorical slots' values are essential to address in order to bridge the gap between spoken and chat-based dialogue systems. We explore potential solutions to improve transcriptions and help dialogue state tracking generative models correct such errors.


title: Is one brick enough to break the wall of spoken dialogue state tracking?

abstract: In Task-Oriented Dialogue (TOD) systems, correctly updating the system's understanding of the user's needs (a.k.a dialogue state tracking) is key to a smooth interaction. Traditionally, TOD systems perform this update in three steps: transcription of the user's utterance, semantic extraction of the key concepts, and contextualization with the previously identified concepts. Such cascade approaches suffer from cascading errors and separate optimization. End-to-End approaches have been proved helpful up to the semantic extraction step. This paper goes one step further paving the path towards completely neural spoken dialogue state tracking by comparing three approaches: (1) a state of the art cascade approach, (2) a locally E2E approach with rule-based contextualization and (3) a completely neural approach.


title: Tuning-less Object Naming with a Foundation Model

abstract: We implement a real-time object naming system that enables learning a set of named entities never seen. Our approach employs an existing foundation model that we consider ready to see anything before starting. It turns seen images into relatively small feature vectors that we associate with index to a gradually built vocabulary without any training of fine-tuning of the model. Our contribution is using the association mechanism known from transformers as attention. It has features that support generalization from irrelevant information for distinguishing the entities and potentially enable associating with much more than indices to vocabulary. As a result, the system can work in a one-shot manner and correctly name objects named in different contents. We also outline implementation details of the system modules integrated by a blackboard architecture. Finally, we investigate the system's quality, mainly how many objects it can handle in this way.


title: Investigating Deep-Learning NLP for Automating the Extraction of Oncology Efficacy Endpoints from Scientific Literature

abstract: Benchmarking drug efficacy is a critical step in clinical trial design and planning. The challenge is that much of the data on efficacy endpoints is stored in scientific papers in free text form, so extraction of such data is currently a largely manual task. Our objective is to automate this task as much as possible. In this study we have developed and optimised a framework to extract efficacy endpoints from text in scientific papers, using a machine learning approach. Our machine learning model predicts 25 classes associated with efficacy endpoints and leads to high F1 scores (harmonic mean of precision and recall) of 96.4% on the test set, and 93.9% and 93.7% on two case studies. These methods were evaluated against - and showed strong agreement with - subject matter experts and show significant promise in the future of automating the extraction of clinical endpoints from free text. Clinical information extraction from text data is currently a laborious manual task which scales poorly and is prone to human error. Demonstrating the ability to extract efficacy endpoints automatically shows great promise for accelerating clinical trial design moving forwards.


title: More Robots are Coming: Large Multimodal Models (ChatGPT) can Solve Visually Diverse Images of Parsons Problems

abstract: The advent of large language models is reshaping computing education. Recent research has demonstrated that these models can produce better explanations than students, answer multiple-choice questions at or above the class average, and generate code that can pass automated tests in introductory courses. These capabilities have prompted instructors to rapidly adapt their courses and assessment methods to accommodate changes in learning objectives and the potential for academic integrity violations. While some scholars have advocated for the integration of visual problems as a safeguard against the capabilities of language models, new multimodal language models now have vision and language capabilities that may allow them to analyze and solve visual problems. In this paper, we evaluate the performance of two large multimodal models on visual assignments, with a specific focus on Parsons problems presented across diverse visual representations. Our results show that GPT-4V solved 96.7\% of these visual problems, struggling minimally with a single Parsons problem. Conversely, Bard performed poorly by only solving 69.2\% of problems, struggling with common issues like hallucinations and refusals. These findings suggest that merely transitioning to visual programming problems might not be a panacea to issues of academic integrity in the generative AI era.


title: Contextualizing the Limits of Model & Evaluation Dataset Curation on Semantic Similarity Classification Tasks

abstract: This paper demonstrates how the limitations of pre-trained models and open evaluation datasets factor into assessing the performance of binary semantic similarity classification tasks. As (1) end-user-facing documentation around the curation of these datasets and pre-trained model training regimes is often not easily accessible and (2) given the lower friction and higher demand to quickly deploy such systems in real-world contexts, our study reinforces prior work showing performance disparities across datasets, embedding techniques and distance metrics, while highlighting the importance of understanding how data is collected, curated and analyzed in semantic similarity classification.


title: Leveraging Large Language Models for Collective Decision-Making

abstract: In various work contexts, such as meeting scheduling, collaborating, and project planning, collective decision-making is essential but often challenging due to diverse individual preferences, varying work focuses, and power dynamics among members. To address this, we propose a system leveraging Large Language Models (LLMs) to facilitate group decision-making by managing conversations and balancing preferences among individuals. Our system aims to extract individual preferences from conversations and suggest options that satisfy the preferences of the members. We specifically apply this system to corporate meeting scheduling. We create synthetic employee profiles and simulate conversations at scale, leveraging LLMs to evaluate the system performance as a novel approach to conducting a user study. Our results indicate efficient coordination with reduced interactions between the members and the LLM-based system. The system refines and improves its proposed options over time, ensuring that many of the members' individual preferences are satisfied in an equitable way. Finally, we conduct a survey study involving human participants to assess our system's ability to aggregate preferences and reasoning about them. Our findings show that the system exhibits strong performance in both dimensions.


title: An Interdisciplinary Outlook on Large Language Models for Scientific Research

abstract: In this paper, we describe the capabilities and constraints of Large Language Models (LLMs) within disparate academic disciplines, aiming to delineate their strengths and limitations with precision. We examine how LLMs augment scientific inquiry, offering concrete examples such as accelerating literature review by summarizing vast numbers of publications, enhancing code development through automated syntax correction, and refining the scientific writing process. Simultaneously, we articulate the challenges LLMs face, including their reliance on extensive and sometimes biased datasets, and the potential ethical dilemmas stemming from their use. Our critical discussion extends to the varying impacts of LLMs across fields, from the natural sciences, where they help model complex biological sequences, to the social sciences, where they can parse large-scale qualitative data. We conclude by offering a nuanced perspective on how LLMs can be both a boon and a boundary to scientific progress.


title: Large language models implicitly learn to straighten neural sentence trajectories to construct a predictive representation of natural language

abstract: Predicting upcoming events is critical to our ability to interact with our environment. Transformer models, trained on next-word prediction, appear to construct representations of linguistic input that can support diverse downstream tasks. But how does a predictive objective shape such representations? Inspired by recent work in vision (Henaff et al., 2019), we test a hypothesis about predictive representations of autoregressive transformers. In particular, we test whether the neural trajectory of a sentence becomes progressively straighter as it passes through the network layers. The key insight is that straighter trajectories should facilitate prediction via linear extrapolation. We quantify straightness using a 1-dimensional curvature metric, and present four findings in support of the trajectory straightening hypothesis: i) In trained models, the curvature decreases from the early to the deeper layers of the network. ii) Models that perform better on the next-word prediction objective exhibit greater decreases in curvature, suggesting that this improved ability to straighten sentence trajectories may be the driver of better language modeling performance. iii) Given the same linguistic context, the sequences that are generated by the model have lower curvature than the actual continuations observed in a language corpus, suggesting that the model favors straighter trajectories for making predictions. iv) A consistent relationship holds between the average curvature and the average surprisal of sentences in the deep model layers, such that sentences with straighter trajectories also have lower surprisal. Importantly, untrained models do not exhibit these behaviors. In tandem, these results support the trajectory straightening hypothesis and provide a possible mechanism for how the geometry of the internal representations of autoregressive models supports next word prediction.


title: GPT4All: An Ecosystem of Open Source Compressed Language Models

abstract: Large language models (LLMs) have recently achieved human-level performance on a range of professional and academic benchmarks. The accessibility of these models has lagged behind their performance. State-of-the-art LLMs require costly infrastructure; are only accessible via rate-limited, geo-locked, and censored web interfaces; and lack publicly available code and technical reports. In this paper, we tell the story of GPT4All, a popular open source repository that aims to democratize access to LLMs. We outline the technical details of the original GPT4All model family, as well as the evolution of the GPT4All project from a single model into a fully fledged open source ecosystem. It is our hope that this paper acts as both a technical overview of the original GPT4All models as well as a case study on the subsequent growth of the GPT4All open source ecosystem.


title: GC-VTON: Predicting Globally Consistent and Occlusion Aware Local Flows with Neighborhood Integrity Preservation for Virtual Try-on

abstract: Flow based garment warping is an integral part of image-based virtual try-on networks. However, optimizing a single flow predicting network for simultaneous global boundary alignment and local texture preservation results in sub-optimal flow fields. Moreover, dense flows are inherently not suited to handle intricate conditions like garment occlusion by body parts or by other garments. Forcing flows to handle the above issues results in various distortions like texture squeezing, and stretching. In this work, we propose a novel approach where we disentangle the global boundary alignment and local texture preserving tasks via our GlobalNet and LocalNet modules. A consistency loss is then employed between the two modules which harmonizes the local flows with the global boundary alignment. Additionally, we explicitly handle occlusions by predicting body-parts visibility mask, which is used to mask out the occluded regions in the warped garment. The masking prevents the LocalNet from predicting flows that distort texture to compensate for occlusions. We also introduce a novel regularization loss (NIPR), that defines a criteria to identify the regions in the warped garment where texture integrity is violated (squeezed or stretched). NIPR subsequently penalizes the flow in those regions to ensure regular and coherent warps that preserve the texture in local neighborhoods. Evaluation on a widely used virtual try-on dataset demonstrates strong performance of our network compared to the current SOTA methods.


title: Evaluating Large Language Models in Ophthalmology

abstract: Purpose: The performance of three different large language models (LLMS) (GPT-3.5, GPT-4, and PaLM2) in answering ophthalmology professional questions was evaluated and compared with that of three different professional populations (medical undergraduates, medical masters, and attending physicians). Methods: A 100-item ophthalmology single-choice test was administered to three different LLMs (GPT-3.5, GPT-4, and PaLM2) and three different professional levels (medical undergraduates, medical masters, and attending physicians), respectively. The performance of LLM was comprehensively evaluated and compared with the human group in terms of average score, stability, and confidence. Results: Each LLM outperformed undergraduates in general, with GPT-3.5 and PaLM2 being slightly below the master's level, while GPT-4 showed a level comparable to that of attending physicians. In addition, GPT-4 showed significantly higher answer stability and confidence than GPT-3.5 and PaLM2. Conclusion: Our study shows that LLM represented by GPT-4 performs better in the field of ophthalmology. With further improvements, LLM will bring unexpected benefits in medical education and clinical decision making in the near future.


title: Prompt Cache: Modular Attention Reuse for Low-Latency Inference

abstract: We present Prompt Cache, an approach for accelerating inference for large language models (LLM) by reusing attention states across different LLM prompts. Many input prompts have overlapping text segments, such as system messages, prompt templates, and documents provided for context. Our key insight is that by precomputing and storing the attention states of these frequently occurring text segments on the inference server, we can efficiently reuse them when these segments appear in user prompts. Prompt Cache employs a schema to explicitly define such reusable text segments, called prompt modules. The schema ensures positional accuracy during attention state reuse and provides users with an interface to access cached states in their prompt. Using a prototype implementation, we evaluate Prompt Cache across several LLMs. We show that Prompt Cache significantly reduce latency in time-to-first-token, especially for longer prompts such as document-based question answering and recommendations. The improvements range from 8x for GPU-based inference to 60x for CPU-based inference, all while maintaining output accuracy and without the need for model parameter modifications.


title: Node-Bound Communities for Partition of Unity Interpolation on Graphs

abstract: Graph signal processing benefits significantly from the direct and highly adaptable supplementary techniques offered by partition of unity methods (PUMs) on graphs. In our approach, we demonstrate the generation of a partition of unity solely based on the underlying graph structure, employing an algorithm that relies exclusively on centrality measures and modularity, without requiring the input of the number of subdomains. Subsequently, we integrate PUMs with a local graph basis function (GBF) approximation method to develop cost-effective global interpolation schemes. We also discuss numerical experiments conducted on both synthetic and real datasets to assess the performance of this presented technique.